vm-test-run-nixbot-gitlab
checks.x86_64-linux.nixbot-gitlab
· build #253
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.lFUMmmKmfp', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13gitlab # Discarding device blocks: 0/262144 done14(finished: start all VMs, in 50.12 seconds)15gitlab: waiting for unit setup-gitlab.service16gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes17gitlab: waiting for the VM to finish booting18gitlab # Filesystem UUID: 54008c72-d61c-4d70-bc22-ee8127d520f419gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 202645gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/nzgh8ac3jh0k74bnmxz5x4jwwzk7fn57-nixos-system-gitlab-test/init regInfo=/nix/store/z1c9h8wjy1bmi4c9dc30jbrxy0vfgx6s-closure-info/registration console=ttyS0,115200n8 console=tty046gitlab # [ 0.000000] BIOS-provided physical RAM map:47gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable48gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved49gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable51gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable55gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved56gitlab # [ 0.000000] NX (Execute Disable) protection: active57gitlab # [ 0.000000] APIC: Static calls initialized58gitlab # [ 0.000000] SMBIOS 2.8 present.59gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201460gitlab # [ 0.000000] DMI: Memory slots populated: 1/161gitlab # [ 0.000000] Hypervisor detected: KVM62gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000063gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0064gitlab # [ 0.000000] kvm-clock: using sched offset of 468349015 cycles65gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns66gitlab # [ 0.000005] tsc: Detected 2400.008 MHz processor67gitlab # [ 0.000805] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000068gitlab # [ 0.000832] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs69gitlab # [ 0.000834] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT70gitlab # [ 0.000873] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000071gitlab # [ 0.002725] found SMP MP-table at [mem 0x000f5470-0x000f547f]72gitlab # [ 0.002736] Using GB pages for direct mapping73gitlab # [ 0.002851] RAMDISK: [mem 0xbe31c000-0xbffcffff]74gitlab # [ 0.002860] ACPI: Early table checksum verification disabled75gitlab # [ 0.002863] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )76gitlab # [ 0.002867] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)77gitlab # [ 0.002871] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002879] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002881] ACPI: FACS 0x00000000BFFE0000 00004080gitlab # [ 0.002882] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)81gitlab # [ 0.002884] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002885] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002887] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]84gitlab # [ 0.002888] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]85gitlab # [ 0.002888] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]86gitlab # [ 0.002889] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]87gitlab # [ 0.002889] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]88gitlab # [ 0.002890] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]89gitlab # [ 0.003124] No NUMA configuration found90gitlab # [ 0.003125] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]91gitlab # [ 0.003128] NODE_DATA(0) allocated [mem 0x1bfffa780-0x1bffffcff]92gitlab # [ 0.005556] Zone ranges:93gitlab # [ 0.005557] DMA [mem 0x0000000000001000-0x0000000000ffffff]94gitlab # [ 0.005559] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]95gitlab # [ 0.005560] Normal [mem 0x0000000100000000-0x00000001bfffffff]96gitlab # [ 0.005561] Device empty97gitlab # [ 0.005562] Movable zone start for each node98gitlab # [ 0.005562] Early memory node ranges99gitlab # [ 0.005563] node 0: [mem 0x0000000000001000-0x000000000009efff]100gitlab # [ 0.005564] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]101gitlab # [ 0.005565] node 0: [mem 0x0000000100000000-0x00000001bfffffff]102gitlab # [ 0.005566] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]103gitlab # [ 0.005586] On node 0, zone DMA: 1 pages in unavailable ranges104gitlab # [ 0.006340] On node 0, zone DMA: 97 pages in unavailable ranges105gitlab # [ 0.121009] On node 0, zone Normal: 40 pages in unavailable ranges106gitlab # [ 0.121432] ACPI: PM-Timer IO Port: 0x608107gitlab # [ 0.121449] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])108gitlab # [ 0.121487] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23109gitlab # [ 0.121489] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)110gitlab # [ 0.121491] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)111gitlab # [ 0.121492] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)112gitlab # [ 0.121494] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)113gitlab # [ 0.121494] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)114gitlab # [ 0.121497] ACPI: Using ACPI (MADT) for SMP configuration information115gitlab # [ 0.121498] ACPI: HPET id: 0x8086a201 base: 0xfed00000116gitlab # [ 0.121503] TSC deadline timer available117gitlab # [ 0.121507] CPU topo: Max. logical packages: 1118gitlab # [ 0.121508] CPU topo: Max. logical dies: 1119gitlab # [ 0.121509] CPU topo: Max. dies per package: 1120gitlab # [ 0.121512] CPU topo: Max. threads per core: 1121gitlab # [ 0.121513] CPU topo: Num. cores per package: 4122gitlab # [ 0.121513] CPU topo: Num. threads per package: 4123gitlab # [ 0.121514] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs124gitlab # [ 0.121541] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()125gitlab # [ 0.121559] kvm-guest: KVM setup pv remote TLB flush126gitlab # [ 0.121561] kvm-guest: setup PV sched yield127gitlab # [ 0.121578] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]128gitlab # [ 0.121580] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]129gitlab # [ 0.121581] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]130gitlab # [ 0.121583] [mem 0xc0000000-0xfeffbfff] available for PCI devices131gitlab # [ 0.121585] Booting paravirtualized kernel on KVM132gitlab # [ 0.121589] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns133gitlab # [ 0.126046] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1134gitlab # [ 0.128377] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288135gitlab # [ 0.128427] kvm-guest: PV spinlocks enabled136gitlab # [ 0.128429] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)137gitlab # [ 0.128432] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/nzgh8ac3jh0k74bnmxz5x4jwwzk7fn57-nixos-system-gitlab-test/init regInfo=/nix/store/z1c9h8wjy1bmi4c9dc30jbrxy0vfgx6s-closure-info/registration console=ttyS0,115200n8 console=tty0138gitlab # [ 0.128533] Unknown kernel command line parameters "regInfo=/nix/store/z1c9h8wjy1bmi4c9dc30jbrxy0vfgx6s-closure-info/registration", will be passed to user space.139gitlab # [ 0.128546] random: crng init done140gitlab # [ 0.128546] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes141gitlab # [ 0.137937] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)142gitlab # [ 0.142490] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)143gitlab # [ 0.142565] software IO TLB: area num 4.144gitlab # [ 0.223230] Fallback order for Node 0: 0145gitlab # [ 0.223239] Built 1 zonelists, mobility grouping on. Total pages: 1572726146gitlab # [ 0.223241] Policy zone: Normal147gitlab # [ 0.225887] mem auto-init: stack:all(zero), heap alloc:on, heap free:off148gitlab # [ 0.236339] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1149gitlab # [ 0.251062] allocated 12582912 bytes of page_ext150gitlab # [ 0.261449] ftrace: allocating 48717 entries in 192 pages151gitlab # [ 0.261451] ftrace: allocated 192 pages with 2 groups152gitlab # [ 0.262355] Dynamic Preempt: lazy153gitlab # [ 0.262543] rcu: Preemptible hierarchical RCU implementation.154gitlab # [ 0.262543] rcu: RCU event tracing is enabled.155gitlab # [ 0.262544] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.156gitlab # [ 0.262546] Trampoline variant of Tasks RCU enabled.157gitlab # [ 0.262547] Rude variant of Tasks RCU enabled.158gitlab # [ 0.262547] Tracing variant of Tasks RCU enabled.159gitlab # [ 0.262548] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.160gitlab # [ 0.262548] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4161gitlab # [ 0.262579] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.162gitlab # [ 0.262580] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.262581] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.266985] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16165gitlab # [ 0.267327] rcu: srcu_init: Setting srcu_struct sizes based on contention.166gitlab # [ 0.267337] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns167gitlab # [ 0.267457] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)168gitlab # [ 0.271085] Console: colour VGA+ 80x25169gitlab # [ 0.271088] printk: legacy console [tty0] enabled170gitlab # [ 0.301962] printk: legacy console [ttyS0] enabled171gitlab # [ 0.399269] ACPI: Core revision 20250807172gitlab # [ 0.400132] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns173gitlab # [ 0.401651] APIC: Switch to symmetric I/O mode setup174gitlab # [ 0.402597] x2apic enabled175gitlab # [ 0.403372] APIC: Switched APIC routing to: physical x2apic176gitlab # [ 0.404313] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()177gitlab # [ 0.405492] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()178gitlab # [ 0.406959] kvm-guest: setup PV IPIs179gitlab # [ 0.408479] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1180gitlab # [ 0.409493] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns181gitlab # [ 0.411251] Calibrating delay loop (skipped) preset value.. 4800.01 BogoMIPS (lpj=2400008)182gitlab # [ 0.412337] x86/cpu: User Mode Instruction Prevention (UMIP) activated183gitlab # [ 0.413388] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127184gitlab # [ 0.414983] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0185gitlab # [ 0.416057] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto186gitlab # [ 0.417248] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl187gitlab # [ 0.419248] Transient Scheduler Attacks: Vulnerable: No microcode188gitlab # [ 0.420248] Spectre V2 : Mitigation: Enhanced / Automatic IBRS189gitlab # [ 0.421248] Speculative Return Stack Overflow: Mitigation: Safe RET190gitlab # [ 0.422248] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization191gitlab # [ 0.423256] Spectre V2 : Enabling IBPB for BPF192gitlab # [ 0.424249] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier193gitlab # [ 0.425249] active return thunk: srso_alias_return_thunk194gitlab # [ 0.426946] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'195gitlab # [ 0.428248] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'196gitlab # [ 0.429248] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'197gitlab # [ 0.430247] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'198gitlab # [ 0.431248] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'199gitlab # [ 0.432248] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'200gitlab # [ 0.433247] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'201gitlab # [ 0.434248] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256202gitlab # [ 0.436026] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64203gitlab # [ 0.437035] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512204gitlab # [ 0.438028] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024205gitlab # [ 0.439029] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8206gitlab # [ 0.440024] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.207gitlab # [ 0.470150] Freeing SMP alternatives memory: 44K208gitlab # [ 0.470824] pid_max: default: 32768 minimum: 301209gitlab # [ 0.471354] LSM: initializing lsm=capability,landlock,yama,bpf,ima210gitlab # [ 0.472355] landlock: Up and running.211gitlab # [ 0.473249] Yama: becoming mindful.212gitlab # [ 0.474454] LSM support for eBPF active213gitlab # [ 0.475423] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)214gitlab # [ 0.476410] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)215gitlab # [ 0.479465] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)216gitlab # [ 0.480889] Performance Events: Fam17h+ core perfctr, AMD PMU driver.217gitlab # [ 0.481257] ... version: 2218gitlab # [ 0.481976] ... bit width: 48219gitlab # [ 0.482250] ... generic counters: 6220gitlab # [ 0.482975] ... generic bitmap: 000000000000003f221gitlab # [ 0.483250] ... fixed-purpose counters: 0222gitlab # [ 0.484009] ... fixed-purpose bitmap: 0000000000000000223gitlab # [ 0.484250] ... value mask: 0000ffffffffffff224gitlab # [ 0.485195] ... max period: 00007fffffffffff225gitlab # [ 0.485986] ... global_ctrl mask: 000000000000003f226gitlab # [ 0.486361] signal: max sigframe size: 3376227gitlab # [ 0.487168] rcu: Hierarchical SRCU implementation.228gitlab # [ 0.487857] rcu: Max phase no-delay instances is 400.229gitlab # [ 0.488438] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level230gitlab # [ 0.493858] smp: Bringing up secondary CPUs ...231gitlab # [ 0.494656] smpboot: x86: Booting SMP configuration:232gitlab # [ 0.495253] .... node #0, CPUs: #1 #2 #3233gitlab # [ 0.498401] smp: Brought up 1 node, 4 CPUs234gitlab # [ 0.500251] smpboot: Total of 4 processors activated (19200.06 BogoMIPS)235gitlab # [ 0.501593] Memory: 6011296K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260100K reserved, 0K cma-reserved)236gitlab # [ 0.504250] devtmpfs: initialized237gitlab # [ 0.505389] x86/mm: Memory block size: 128MB238gitlab # [ 0.508452] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)239gitlab # [ 0.510291] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).240gitlab # [ 0.511353] pinctrl core: initialized pinctrl subsystem241gitlab # [ 0.512564] PM: RTC time: 08:49:12, date: 2026-08-20242gitlab # [ 0.516719] NET: Registered PF_NETLINK/PF_ROUTE protocol family243gitlab # [ 0.518680] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations244gitlab # [ 0.519316] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations245gitlab # [ 0.521432] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations246gitlab # [ 0.522263] audit: initializing netlink subsys (disabled)247gitlab # [ 0.523279] audit: type=2000 audit(1787215752.059:1): state=initialized audit_enabled=0 res=1248gitlab # [ 0.523548] thermal_sys: Registered thermal governor 'fair_share'249gitlab # [ 0.525252] thermal_sys: Registered thermal governor 'bang_bang'250gitlab # [ 0.526251] thermal_sys: Registered thermal governor 'step_wise'251gitlab # [ 0.527251] thermal_sys: Registered thermal governor 'user_space'252gitlab # [ 0.528250] thermal_sys: Registered thermal governor 'power_allocator'253gitlab # [ 0.529265] cpuidle: using governor menu254gitlab # [ 0.531485] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5255gitlab # [ 0.532489] PCI: Using configuration type 1 for base access256gitlab # [ 0.533252] PCI: Using configuration type 1 for extended access257gitlab # [ 0.534430] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.258gitlab # [ 0.537606] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages259gitlab # [ 0.538252] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page260gitlab # [ 0.539251] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages261gitlab # [ 0.540250] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page262gitlab # [ 0.545906] ACPI: Added _OSI(Module Device)263gitlab # [ 0.547259] ACPI: Added _OSI(Processor Device)264gitlab # [ 0.549257] ACPI: Added _OSI(Processor Aggregator Device)265gitlab # [ 0.556287] ACPI: 1 ACPI AML tables successfully acquired and loaded266gitlab # [ 0.562537] ACPI: Interpreter enabled267gitlab # [ 0.563271] ACPI: PM: (supports S0 S3 S4 S5)268gitlab # [ 0.564010] ACPI: Using IOAPIC for interrupt routing269gitlab # [ 0.565669] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug270gitlab # [ 0.569257] PCI: Using E820 reservations for host bridge windows271gitlab # [ 0.572893] ACPI: Enabled 2 GPEs in block 00 to 0F272gitlab # [ 0.585913] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])273gitlab # [ 0.588316] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]274gitlab # [ 0.593548] acpiphp: Slot [3] registered275gitlab # [ 0.595296] acpiphp: Slot [4] registered276gitlab # [ 0.596294] acpiphp: Slot [5] registered277gitlab # [ 0.597312] acpiphp: Slot [6] registered278gitlab # [ 0.599306] acpiphp: Slot [7] registered279gitlab # [ 0.600293] acpiphp: Slot [8] registered280gitlab # [ 0.601292] acpiphp: Slot [9] registered281gitlab # [ 0.603319] acpiphp: Slot [10] registered282gitlab # [ 0.604295] acpiphp: Slot [11] registered283gitlab # [ 0.605294] acpiphp: Slot [12] registered284gitlab # [ 0.607313] acpiphp: Slot [13] registered285gitlab # [ 0.608293] acpiphp: Slot [14] registered286gitlab # [ 0.609292] acpiphp: Slot [15] registered287gitlab # [ 0.611293] acpiphp: Slot [16] registered288gitlab # [ 0.612309] acpiphp: Slot [17] registered289gitlab # [ 0.613294] acpiphp: Slot [18] registered290gitlab # [ 0.615271] acpiphp: Slot [19] registered291gitlab # [ 0.616004] acpiphp: Slot [20] registered292gitlab # [ 0.616281] acpiphp: Slot [21] registered293gitlab # [ 0.617032] acpiphp: Slot [22] registered294gitlab # [ 0.618272] acpiphp: Slot [23] registered295gitlab # [ 0.619011] acpiphp: Slot [24] registered296gitlab # [ 0.619287] acpiphp: Slot [25] registered297gitlab # [ 0.620016] acpiphp: Slot [26] registered298gitlab # [ 0.620271] acpiphp: Slot [27] registered299gitlab # [ 0.620993] acpiphp: Slot [28] registered300gitlab # [ 0.622272] acpiphp: Slot [29] registered301gitlab # [ 0.623024] acpiphp: Slot [30] registered302gitlab # [ 0.623270] acpiphp: Slot [31] registered303gitlab # [ 0.623969] PCI host bridge to bus 0000:00304gitlab # [ 0.625255] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]305gitlab # [ 0.626257] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]306gitlab # [ 0.627251] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]307gitlab # [ 0.628314] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]308gitlab # [ 0.631257] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]309gitlab # [ 0.634261] pci_bus 0000:00: root bus resource [bus 00-ff]310gitlab # [ 0.637879] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint311gitlab # [ 0.641574] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint312gitlab # [ 0.646313] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint313gitlab # [ 0.653327] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]314gitlab # [ 0.655324] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk315gitlab # [ 0.657257] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk316gitlab # [ 0.660257] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk317gitlab # [ 0.662256] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk318gitlab # [ 0.665708] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint319gitlab # [ 0.671438] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]320gitlab # [ 0.675616] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint321gitlab # [ 0.679796] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI322gitlab # [ 0.681266] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB323gitlab # [ 0.684735] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint324gitlab # [ 0.703387] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]325gitlab # [ 0.704271] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]326gitlab # [ 0.705299] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]327gitlab # [ 0.706822] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]328gitlab # [ 0.710323] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint329gitlab # [ 0.715283] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]330gitlab # [ 0.716187] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]331gitlab # [ 0.717035] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]332gitlab # [ 0.730260] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]333gitlab # [ 0.732962] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint334gitlab # [ 0.737282] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]335gitlab # [ 0.738160] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]336gitlab # [ 0.739024] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]337gitlab # [ 0.741480] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint338gitlab # [ 0.747282] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]339gitlab # [ 0.748172] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]340gitlab # [ 0.749051] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]341gitlab # [ 0.751490] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint342gitlab # [ 0.755303] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]343gitlab # [ 0.757258] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]344gitlab # [ 0.758266] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]345gitlab # [ 0.760488] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint346gitlab # [ 0.763283] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]347gitlab # [ 0.764214] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]348gitlab # [ 0.766052] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]349gitlab # [ 0.768499] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint350gitlab # [ 0.774293] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]351gitlab # [ 0.775207] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]352gitlab # [ 0.776043] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]353gitlab # [ 0.779589] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint354gitlab # [ 0.784296] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]355gitlab # [ 0.786287] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]356gitlab # [ 0.787280] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]357gitlab # [ 0.790264] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]358gitlab # [ 0.792956] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint359gitlab # [ 0.796061] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]360gitlab # [ 0.797173] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]361gitlab # [ 0.801505] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint362gitlab # [ 0.806308] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]363gitlab # [ 0.807259] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]364gitlab # [ 0.808279] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]365gitlab # [ 0.811444] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint366gitlab # [ 0.815283] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]367gitlab # [ 0.816201] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]368gitlab # [ 0.817083] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]369gitlab # [ 0.823369] ACPI: PCI: Interrupt link LNKA configured for IRQ 10370gitlab # [ 0.824403] ACPI: PCI: Interrupt link LNKB configured for IRQ 10371gitlab # [ 0.825388] ACPI: PCI: Interrupt link LNKC configured for IRQ 11372gitlab # [ 0.826379] ACPI: PCI: Interrupt link LNKD configured for IRQ 11373gitlab # [ 0.827340] ACPI: PCI: Interrupt link LNKS configured for IRQ 9374gitlab # [ 0.830632] iommu: Default domain type: Translated375gitlab # [ 0.831254] iommu: DMA domain TLB invalidation policy: lazy mode376gitlab # [ 0.833592] ACPI: bus type USB registered377gitlab # [ 0.834347] usbcore: registered new interface driver usbfs378gitlab # [ 0.835407] usbcore: registered new interface driver hub379gitlab # [ 0.836301] usbcore: registered new device driver usb380gitlab # [ 0.838947] NetLabel: Initializing381gitlab # [ 0.839252] NetLabel: domain hash size = 128382gitlab # [ 0.840015] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO383gitlab # [ 0.841333] NetLabel: unlabeled traffic allowed by default384gitlab # [ 0.843278] PCI: Using ACPI for IRQ routing385gitlab # [ 0.845478] pci 0000:00:02.0: vgaarb: setting as boot VGA device386gitlab # [ 0.846247] pci 0000:00:02.0: vgaarb: bridge control possible387gitlab # [ 0.846247] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none388gitlab # [ 0.853266] vgaarb: loaded389gitlab # [ 0.854790] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0390gitlab # [ 0.857256] hpet0: 3 comparators, 64-bit 100.000000 MHz counter391gitlab # [ 0.863578] clocksource: Switched to clocksource kvm-clock392gitlab # [ 0.867286] VFS: Disk quotas dquot_6.6.0393gitlab # [ 0.868989] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)394gitlab # [ 0.872243] pnp: PnP ACPI init395gitlab # [ 0.875160] pnp: PnP ACPI: found 6 devices396gitlab # [ 0.888480] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns397gitlab # [ 0.891313] clocksource: Switched to clocksource acpi_pm398gitlab # [ 0.893297] NET: Registered PF_INET protocol family399gitlab # [ 0.897398] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)400gitlab # [ 0.921741] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)401gitlab # [ 0.923259] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)402gitlab # [ 0.924681] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)403gitlab # [ 0.928641] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)404gitlab # [ 0.930012] TCP: Hash tables configured (established 65536 bind 65536)405gitlab # [ 0.931190] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)406gitlab # [ 0.932842] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)407gitlab # [ 0.934304] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)408gitlab # [ 0.935663] NET: Registered PF_UNIX/PF_LOCAL protocol family409gitlab # [ 0.936625] NET: Registered PF_XDP protocol family410gitlab # [ 0.937501] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]411gitlab # [ 0.938599] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]412gitlab # [ 0.939634] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]413gitlab # [ 0.940753] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]414gitlab # [ 0.941891] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]415gitlab # [ 0.943270] pci 0000:00:01.0: PIIX3: Enabling Passive Release416gitlab # [ 0.944312] pci 0000:00:00.0: Limiting direct PCI/PCI transfers417gitlab # [ 0.946749] ACPI: \_SB_.LNKD: Enabled at IRQ 11418gitlab # [ 0.949402] PCI: CLS 0 bytes, default 64419gitlab # [ 0.950240] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)420gitlab # [ 0.950798] Trying to unpack rootfs image as initramfs...421gitlab # [ 0.951314] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB)422gitlab # [ 0.951447] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns423gitlab # [ 0.975040] Initialise system trusted keyrings424gitlab # [ 0.976220] workingset: timestamp_bits=40 max_order=21 bucket_order=0425gitlab # [ 0.987573] Key type asymmetric registered426gitlab # [ 0.988327] Asymmetric key parser 'x509' registered427gitlab # [ 0.989263] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)428gitlab # [ 0.990972] io scheduler mq-deadline registered429gitlab # [ 0.991756] io scheduler kyber registered430gitlab # [ 0.995675] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled431gitlab # [ 0.996986] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A432gitlab # [ 0.999315] Linux agpgart interface v0.103433gitlab # [ 1.000146] ACPI: bus type drm_connector registered434gitlab # [ 1.002649] usbcore: registered new interface driver usbserial_generic435gitlab # [ 1.003746] usbserial: USB Serial support registered for generic436gitlab # [ 1.005072] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.437gitlab # [ 1.005072] Please enable it if your BIOS has the CPPC option.438gitlab # [ 1.007595] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled439gitlab # [ 1.009078] drop_monitor: Initializing network drop monitor service440gitlab # [ 1.010321] NET: Registered PF_INET6 protocol family441gitlab # [ 1.011960] Segment Routing with IPv6442gitlab # [ 1.012632] In-situ OAM (IOAM) with IPv6443gitlab # [ 1.014564] IPI shorthand broadcast: enabled444gitlab # [ 1.018949] sched_clock: Marking stable (883014697, 135910381)->(1038804557, -19879479)445gitlab # [ 1.020737] registered taskstats version 1446gitlab # [ 1.021745] Loading compiled-in X.509 certificates447gitlab # [ 1.031734] Demotion targets for Node 0: null448gitlab # [ 1.032964] Key type .fscrypt registered449gitlab # [ 1.033664] Key type fscrypt-provisioning registered450gitlab # [ 1.034608] ima: No TPM chip found, activating TPM-bypass!451gitlab # [ 1.035531] ima: Allocated hash algorithm: sha1452gitlab # [ 1.036373] ima: No architecture policies found453gitlab # [ 1.037460] PM: Magic number: 6:151:827454gitlab # [ 1.038243] misc hw_random: hash matches455gitlab # [ 1.039022] genpd_provider: hash matches456gitlab # [ 1.040664] RAS: Correctable Errors collector initialized.457gitlab # [ 1.045665] clk: Disabling unused clocks458gitlab # [ 1.046386] PM: genpd: Disabling unused power domains459gitlab # [ 1.277879] Freeing initrd memory: 29392K460gitlab # [ 1.285695] Freeing unused decrypted memory: 2028K461gitlab # [ 1.292210] Freeing unused kernel image (initmem) memory: 3640K462gitlab # [ 1.294763] Write protecting the kernel read-only data: 32768k463gitlab # [ 1.299713] Freeing unused kernel image (text/rodata gap) memory: 1220K464gitlab # [ 1.303873] Freeing unused kernel image (rodata/data gap) memory: 760K465gitlab # [ 1.374797] x86/mm: Checked W+X mappings: passed, no W+X pages found.466gitlab # [ 1.375899] Run /init as init process467gitlab # [ 1.388620] systemd[1]: Inserted module 'autofs4'468gitlab # [ 1.411156] fuse: init (API version 7.45)469gitlab # [ 1.419409] ACPI: \_SB_.LNKC: Enabled at IRQ 10470gitlab # [ 1.427206] ACPI: \_SB_.LNKA: Enabled at IRQ 10471gitlab # [ 1.430623] ACPI: \_SB_.LNKB: Enabled at IRQ 11472gitlab # [ 1.465861] systemd[1]: Successfully made /usr/ read-only.473gitlab # [ 1.802698] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)474gitlab # [ 1.842429] systemd[1]: Detected virtualization kvm.475gitlab # [ 1.844558] systemd[1]: Detected architecture x86-64.476gitlab # [ 1.846660] systemd[1]: Running in initrd.477gitlab # [ 1.849137] systemd[1]: Initializing machine ID from random generator.478gitlab # [ 1.851832] systemd[1]: Hostname set to <gitlab>.479gitlab # [ 1.965351] systemd[1]: bpf-restrict-fs: LSM BPF program attached480gitlab # [ 2.006450] systemd[1]: Queued start job for default target Initrd Default Target.481gitlab # [ 2.015516] systemd[1]: Created slice Slice /system/modprobe.482gitlab # [ 2.016699] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.483gitlab # [ 2.018183] systemd[1]: Expecting device /dev/disk/by-label/nix-store...484gitlab # [ 2.019350] systemd[1]: Expecting device /dev/disk/by-label/nixos...485gitlab # [ 2.020477] systemd[1]: Reached target Path Units.486gitlab # [ 2.021370] systemd[1]: Reached target Slice Units.487gitlab # [ 2.022295] systemd[1]: Reached target Swaps.488gitlab # [ 2.023135] systemd[1]: Reached target Timer Units.489gitlab # [ 2.024142] systemd[1]: Listening on D-Bus System Message Bus Socket.490gitlab # [ 2.025375] systemd[1]: Listening on Journal Socket (/dev/log).491gitlab # [ 2.026532] systemd[1]: Listening on Journal Sockets.492gitlab # [ 2.027571] systemd[1]: Listening on udev Control Socket.493gitlab # [ 2.028575] systemd[1]: Listening on udev Kernel Socket.494gitlab # [ 2.029527] systemd[1]: Reached target Socket Units.495gitlab # [ 2.031491] systemd[1]: Starting Create List of Static Device Nodes...496gitlab # [ 2.033777] systemd[1]: Starting Load Kernel Module 9pnet_virtio...497gitlab # [ 2.035745] systemd[1]: Starting Load Kernel Module configfs...498gitlab # [ 2.041995] systemd[1]: Starting Journal Service...499gitlab # [ 2.043868] systemd[1]: Starting Load Kernel Modules...500gitlab # [ 2.044872] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os501gitlab # [ 2.049298] systemd[1]: Starting Coldplug All udev Devices...502gitlab # [ 2.053659] systemd[1]: Finished Create List of Static Device Nodes.503gitlab # [ 2.057849] systemd[1]: modprobe@configfs.service: Deactivated successfully.504gitlab # [ 2.062428] systemd[1]: Finished Load Kernel Module configfs.505gitlab # [ 2.066527] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config506gitlab # [ 2.069216] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.507gitlab # [ 2.070826] systemd-journald[92]: Collecting audit messages is disabled.508gitlab # [ 2.073129] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev509gitlab # [ 2.079754] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...510gitlab # [ 2.089095] systemd[1]: Finished Load Kernel Modules.511gitlab # [ 2.101331] systemd[1]: Starting Apply Kernel Variables...512gitlab # [ 2.109454] netfs: FS-Cache loaded513gitlab # [ 2.114227] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.514gitlab # [ 1.979466] systemd-modules-load[94]: Using 4 probe threads515gitlab # [ 1.980845] systemd-modules-load[94]: Inserted module 'virtio_balloon'516gitlab # [ 2.116612] systemd[1]: Started Journal Service.517gitlab # [ 1.982489] systemd-modules-load[94]: Inserted module 'dm_mod'518gitlab # [ 1.986394] systemd-modules-load[94]: Inserted module 'virtio_gpu'[ 2.122338] 9pnet: Installing 9P2000 support519gitlab # 520gitlab # [ 1.988151] systemd[1]: Finished Apply Kernel Variables.521gitlab # [ 1.989311] systemd[1]: Starting Create Static Device Nodes in /dev...522gitlab # [ 1.992738] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.523gitlab # [ 1.993843] systemd[1]: Finished Load Kernel Module 9pnet_virtio.524gitlab # [ 2.000493] systemd[1]: Finished Create Static Device Nodes in /dev.525gitlab # [ 2.001382] systemd[1]: Reached target Preparation for Local File Systems.526gitlab # [ 2.002296] systemd[1]: Reached target Local File Systems.527gitlab # [ 2.003046] systemd[1]: Starting Create System Files and Directories...528gitlab # [ 2.003997] systemd[1]: Starting Rule-based Manager for Device Events and Files...529gitlab # [ 2.014712] systemd[1]: Finished Create System Files and Directories.530gitlab # [ 2.023781] systemd-udevd[115]: Using default interface naming scheme 'v261'.531gitlab # [ 2.034093] systemd[1]: Started Rule-based Manager for Device Events and Files.532gitlab # [ 2.057109] systemd[1]: Finished Coldplug All udev Devices.533gitlab # [ 2.058083] systemd[1]: Reached target System Initialization.534gitlab # [ 2.058826] systemd[1]: Reached target Basic System.535gitlab # [ 2.268257] uhci_hcd 0000:00:01.2: UHCI Host Controller536gitlab # [ 2.269175] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1537gitlab # [ 2.270226] uhci_hcd 0000:00:01.2: detected 2 ports538gitlab # [ 2.271497] virtio_blk virtio4: 4/0/0 default/read/poll queues539gitlab # [ 2.272286] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140540gitlab # [ 2.274223] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18541gitlab # [ 2.275362] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1542gitlab # [ 2.276505] usb usb1: Product: UHCI Host Controller543gitlab # [ 2.277334] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd544gitlab # [ 2.278171] usb usb1: SerialNumber: 0000:00:01.2545gitlab # [ 2.280508] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)546gitlab # [ 2.285064] SCSI subsystem initialized547gitlab # [ 2.285093] hub 1-0:1.0: USB hub found548gitlab # [ 2.286414] hub 1-0:1.0: 2 ports detected549gitlab # [ 2.288241] virtio_blk virtio5: 4/0/0 default/read/poll queues550gitlab # [ 2.297125] virtio_blk virtio5: [vdb] 11789224 512-byte logical blocks (6.04 GB/5.62 GiB)551gitlab # [ 2.301661] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12552gitlab # [ 2.303474] serio: i8042 KBD port at 0x60,0x64 irq 1553gitlab # [ 2.304196] serio: i8042 AUX port at 0x60,0x64 irq 12554gitlab # [ 2.196310] (udev-worker)[132]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.555gitlab # [ 2.198360] (udev-worker)[132]: Network interface NamePolicy= disabled on kernel command line.556gitlab # [ 2.202375] (udev-worker)[140]: Network interface NamePolicy= disabled on kernel command line.557gitlab # [ 2.205337] systemd[1]: Starting Virtual Console Setup...558gitlab # [ 2.349705] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0559gitlab # [ 2.359094] scsi host0: ata_piix560gitlab # [ 2.223971] systemd[1]: Found device /dev/disk/by-label/nixos.561gitlab # [ 2.361263] scsi host1: ata_piix562gitlab # [ 2.362196] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0563gitlab # [ 2.227281] systemd[1]: Found device /dev/disk/by-label/nix-store.564gitlab # [ 2.363420] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0565gitlab # [ 2.228480] systemd[1]: Reached target Initrd Root Device.566gitlab # [ 2.229889] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...567gitlab # [ 2.230953] systemd-vconsole-setup[148]: Configuration of first virtual console was skipped, ignoring remaining ones.568gitlab # [ 2.238475] systemd[1]: Finished Virtual Console Setup.569gitlab # [ 2.253685] systemd-fsck[159]: nixos: clean, 12/65536 files, 13019/262144 blocks570gitlab # [ 2.257793] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.571gitlab # [ 2.509099] usb 1-1: new full-speed USB device number 2 using uhci_hcd572gitlab # [ 2.524614] ata2: found unknown device (class 0)573gitlab # [ 2.527319] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100574gitlab # [ 2.531279] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5575gitlab # [ 2.590248] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray576gitlab # [ 2.617574] cdrom: Uniform CD-ROM driver Revision: 3.20577gitlab # [ 2.678645] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00578gitlab # [ 2.681004] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10579gitlab # [ 2.682958] usb 1-1: Product: QEMU USB Tablet580gitlab # [ 2.684160] usb 1-1: Manufacturer: QEMU581gitlab # [ 2.685260] usb 1-1: SerialNumber: 28754-0000:00:01.2-1582gitlab # [ 2.715125] hid: raw HID events driver (C) Jiri Kosina583gitlab # [ 2.728486] usbcore: registered new interface driver usbhid584gitlab # [ 2.730480] usbhid: USB HID core driver585gitlab # [ 2.739357] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2586gitlab # [ 2.743897] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0587gitlab # [ 2.918282] systemd[1]: Mounting /sysroot...588gitlab # [ 3.197728] EXT4-fs (vda): mounted filesystem 54008c72-d61c-4d70-bc22-ee8127d520f4 r/w with ordered data mode. Quota mode: none.589gitlab # [ 3.068762] systemd[1]: Mounted /sysroot.590gitlab # [ 3.069931] systemd[1]: Reached target Initrd Root File System.591gitlab # [ 3.073295] systemd[1]: Mounting /sysroot/nix/.ro-store...592gitlab # [ 3.075201] systemd[1]: Mounting /sysroot/nix/.rw-store...593gitlab # [ 3.078697] systemd[1]: Mounting /sysroot/run...594gitlab # [ 3.080294] systemd[1]: Mounting /sysroot/tmp/shared...595gitlab # [ 3.095222] systemd[1]: Mounting /sysroot/tmp/xchg...596gitlab # [ 3.098356] systemd[1]: Starting Mountpoints Configured in the Real Root...597gitlab # [ 3.106149] systemd[1]: Mounted /sysroot/nix/.rw-store.598gitlab # [ 3.106889] systemd[1]: Mounted /sysroot/run.599gitlab # [ 3.109074] systemd[1]: Starting rw-sysroot-nix-store.service...600gitlab # [ 3.255687] 9p: Installing v9fs 9p2000 file system support601gitlab # [ 3.258510] erofs (device vdb): mounted with root inode @ nid 128.602gitlab # [ 3.128106] systemd[1]: Mounted /sysroot/nix/.ro-store.603gitlab # [ 3.129048] systemd[1]: Mounted /sysroot/tmp/shared.604gitlab # [ 3.130113] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.605gitlab # [ 3.132326] systemd[1]: Finished rw-sysroot-nix-store.service.606gitlab # [ 3.135667] systemd-sysroot-fstab-check[179]: /sysroot should be mounted in the initrd, will request daemon-reload.607gitlab # [ 3.138803] systemd[1]: Mounted /sysroot/tmp/xchg.608gitlab # [ 3.139949] systemd[1]: Reload requested from client PID 179 ('systemd-sysroot') (unit initrd-parse-etc.service)...609gitlab # [ 3.141573] systemd[1]: Reloading...610gitlab # [ 3.201538] systemd[1]: Reloading finished in 59 ms.611gitlab # [ 3.224444] systemd-sysroot-fstab-check[179]: Requesting initrd-fs.target/start/replace...612gitlab # [ 3.226101] systemd-sysroot-fstab-check[179]: Requesting swap.target/start/replace...613gitlab # [ 3.228112] systemd[1]: Starting rw-sysroot-nix-store.service...614gitlab # [ 3.229424] systemd[1]: initrd-parse-etc.service: Deactivated successfully.615gitlab # [ 3.230807] systemd[1]: Finished Mountpoints Configured in the Real Root.616gitlab # [ 3.232223] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.617gitlab # [ 3.256908] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.618gitlab # [ 3.258405] systemd[1]: Finished rw-sysroot-nix-store.service.619gitlab # [ 3.918927] systemd[1]: Mounting /sysroot/nix/store...620gitlab # [ 3.971596] systemd[1]: Mounted /sysroot/nix/store.621gitlab # [ 3.973663] systemd[1]: Reached target Initrd File Systems.622gitlab # [ 3.976102] systemd[1]: Starting Find NixOS closure...623gitlab # [ 3.978107] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...624gitlab # [ 4.007381] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.625gitlab # [ 4.010465] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.626gitlab # [ 4.028482] systemd[1]: Finished Find NixOS closure.627gitlab # [ 4.030277] systemd[1]: Reached target Initrd Default Target.628gitlab # [ 4.032246] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...629gitlab # [ 4.062500] systemd[1]: Stopped target Initrd Default Target.630gitlab # [ 4.064455] systemd[1]: Stopped target Basic System.631gitlab # [ 4.066169] systemd[1]: Stopped target Initrd Root Device.632gitlab # [ 4.067991] systemd[1]: Stopped target Path Units.633gitlab # [ 4.070089] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.634gitlab # [ 4.072512] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.635gitlab # [ 4.074926] systemd[1]: Stopped target Slice Units.636gitlab # [ 4.077339] systemd[1]: Stopped target Socket Units.637gitlab # [ 4.078972] systemd[1]: Stopped target System Initialization.638gitlab # [ 4.080895] systemd[1]: Stopped target Swaps.639gitlab # [ 4.082761] systemd[1]: Stopped target Timer Units.640gitlab # [ 4.084432] systemd[1]: dbus.socket: Deactivated successfully.641gitlab # [ 4.086322] systemd[1]: Closed D-Bus System Message Bus Socket.642gitlab # [ 4.088269] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.643gitlab # [ 4.091624] systemd[1]: Stopped Find NixOS closure.644gitlab # [ 4.094318] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio645gitlab # [ 4.097916] systemd[1]: Starting rw-sysroot-nix-store.service...646gitlab # [ 4.099945] systemd[1]: systemd-sysctl.service: Deactivated successfully.647gitlab # [ 4.102751] systemd[1]: Stopped Apply Kernel Variables.648gitlab # [ 4.104456] systemd[1]: systemd-modules-load.service: Deactivated successfully.649gitlab # [ 4.106537] systemd[1]: Stopped Load Kernel Modules.650gitlab # [ 4.107970] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.651gitlab # [ 4.110089] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.652gitlab # [ 4.111993] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.653gitlab # [ 4.113845] systemd[1]: Stopped Create System Files and Directories.654gitlab # [ 4.115373] systemd[1]: Stopped target Local File Systems.655gitlab # [ 4.116733] systemd[1]: Stopped target Preparation for Local File Systems.656gitlab # [ 4.118430] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.657gitlab # [ 4.120223] systemd[1]: Stopped Coldplug All udev Devices.658gitlab # [ 4.121546] systemd[1]: Stopping Rule-based Manager for Device Events and Files...659gitlab # [ 4.123310] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.660gitlab # [ 4.125131] systemd[1]: Stopped Virtual Console Setup.661gitlab # [ 4.126312] systemd[1]: initrd-cleanup.service: Deactivated successfully.662gitlab # [ 4.127364] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.663gitlab # [ 4.128426] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.664gitlab # [ 4.129546] systemd[1]: Finished rw-sysroot-nix-store.service.665gitlab # [ 4.130517] systemd[1]: systemd-udevd.service: Deactivated successfully.666gitlab # [ 4.131542] systemd[1]: Stopped Rule-based Manager for Device Events and Files.667gitlab # [ 4.132482] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.668gitlab # [ 4.133370] systemd[1]: Closed udev Control Socket.669gitlab # [ 4.134069] systemd[1]: Starting Cleanup udev Database...670gitlab # [ 4.134769] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.671gitlab # [ 4.135729] systemd[1]: Stopped Create Static Device Nodes in /dev.672gitlab # [ 4.136533] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.673gitlab # [ 4.137632] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.674gitlab # [ 4.138518] systemd[1]: kmod-static-nodes.service: Deactivated successfully.675gitlab # [ 4.139429] systemd[1]: Stopped Create List of Static Device Nodes.676gitlab # [ 4.153932] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.677gitlab # [ 4.154861] systemd[1]: Finished Cleanup udev Database.678gitlab # [ 4.155511] systemd[1]: Reached target Switch Root.679gitlab # [ 4.156169] systemd[1]: Starting NixOS Activation...680gitlab # [ 4.267810] initrd-nixos-activation-start[226]: booting system configuration /nix/store/nzgh8ac3jh0k74bnmxz5x4jwwzk7fn57-nixos-system-gitlab-test681gitlab # [ 4.310187] initrd-nixos-activation-start[226]: running activation script...682gitlab # [ 4.543312] initrd-nixos-activation-start[249]: setting up /etc...683gitlab # [ 4.654315] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.684gitlab # [ 4.655829] systemd[1]: Finished NixOS Activation.685gitlab # [ 4.658875] systemd[1]: Starting Switch Root...686gitlab # [ 4.690455] systemd[1]: Switching root.687gitlab # [ 4.883192] systemd-journald[92]: Received SIGTERM from PID 1 (systemd).688gitlab # [ 4.984495] NET: Registered PF_VSOCK protocol family689gitlab # [ 5.350349] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)690gitlab # [ 5.359959] systemd[1]: Detected virtualization kvm.691gitlab # [ 5.361695] systemd[1]: Detected architecture x86-64.692gitlab # [ 5.363612] systemd[1]: Detected first boot.693gitlab # [ 5.366104] systemd[1]: Initializing machine ID from random generator.694gitlab # [ 5.518467] systemd[1]: bpf-restrict-fs: LSM BPF program attached695gitlab # [ 5.611783] systemd[1]: Applying preset policy.696gitlab # [ 5.735870] systemd[1]: Populated /etc with preset unit settings.697gitlab # [ 5.849631] systemd[1]: initrd-switch-root.service: Deactivated successfully.698gitlab # [ 5.850883] systemd[1]: Stopped initrd-switch-root.service.699gitlab # [ 5.853036] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.700gitlab # [ 5.855061] systemd[1]: Created slice Slice /system/getty.701gitlab # [ 5.856380] systemd[1]: Created slice GitLab DevOps Platform Slice.702gitlab # [ 5.857733] systemd[1]: Created slice User and Session Slice.703gitlab # [ 5.858684] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.704gitlab # [ 5.859839] systemd[1]: Started Forward Password Requests to Wall Directory Watch.705gitlab # [ 5.860944] systemd[1]: Expecting device /dev/hvc0...706gitlab # [ 5.861618] systemd[1]: Expecting device /dev/ttyS0...707gitlab # [ 5.862331] systemd[1]: Reached target Local Encrypted Volumes.708gitlab # [ 5.863133] systemd[1]: Stopped target initrd-fs.target.709gitlab # [ 5.863856] systemd[1]: Stopped target initrd-root-fs.target.710gitlab # [ 5.864629] systemd[1]: Stopped target initrd-switch-root.target.711gitlab # [ 5.865449] systemd[1]: Reached target Virtual Machines and Containers.712gitlab # [ 5.866402] systemd[1]: Reached target Path Units.713gitlab # [ 5.867113] systemd[1]: Reached target Remote File Systems.714gitlab # [ 5.867890] systemd[1]: Reached target Slice Units.715gitlab # [ 5.868580] systemd[1]: Reached target Swaps.716gitlab # [ 5.869985] systemd[1]: Listening on Query the User Interactively for a Password.717gitlab # [ 5.871817] systemd[1]: Listening on Process Core Dump Socket.718gitlab # [ 5.873136] systemd[1]: Listening on Credential Encryption/Decryption.719gitlab # [ 5.874668] systemd[1]: Listening on Factory Reset Management.720gitlab # [ 5.875536] systemd[1]: Listening on Hostname Service Socket.721gitlab # [ 5.877766] systemd[1]: Starting Journal Log Access Socket...722gitlab # [ 5.879031] systemd[1]: Listening on Journal Audit Socket.723gitlab # [ 5.880965] systemd[1]: Listening on Console Output Muting Service Socket.724gitlab # [ 5.882146] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.725gitlab # [ 5.883253] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os726gitlab # [ 5.884554] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki727gitlab # [ 5.887246] systemd[1]: Listening on Disk Repartitioning Service Socket.728gitlab # [ 5.888258] systemd[1]: Listening on udev Control Socket.729gitlab # [ 5.889121] systemd[1]: Listening on udev Varlink Socket.730gitlab # [ 5.891749] systemd[1]: Mounting Huge Pages File System...731gitlab # [ 5.893783] systemd[1]: Mounting POSIX Message Queue File System...732gitlab # [ 5.895815] systemd[1]: Mounting Kernel Debug File System...733gitlab # [ 5.898210] systemd[1]: Mounting Kernel Trace File System...734gitlab # [ 5.902344] systemd[1]: Starting Create List of Static Device Nodes...735gitlab # [ 5.903409] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio736gitlab # [ 5.908002] systemd[1]: Starting Load Kernel Module configfs...737gitlab # [ 5.909684] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm738gitlab # [ 5.911202] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore739gitlab # [ 5.912826] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse740gitlab # [ 5.916513] systemd[1]: Mounting FUSE Control File System...741gitlab # [ 5.922179] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67742gitlab # [ 5.959525] systemd[1]: Starting Journal Service...743gitlab # [ 5.963067] systemd[1]: Starting Load Kernel Modules...744gitlab # [ 5.971665] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...745gitlab # [ 5.977094] systemd[1]: Starting Remount Root and Kernel File Systems...746gitlab # [ 5.979045] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os747gitlab # [ 5.984732] loop: module loaded748gitlab # [ 5.984864] systemd-journald[319]: Collecting audit messages is enabled.749gitlab # [ 5.989084] systemd[1]: Starting Coldplug All udev Devices...750gitlab # [ 5.992180] systemd[1]: Listening on Journal Log Access Socket.751gitlab # [ 5.993482] systemd[1]: Mounted Huge Pages File System.752gitlab # [ 5.994389] systemd[1]: Mounted POSIX Message Queue File System.753gitlab # [ 5.995414] systemd[1]: Mounted Kernel Debug File System.754gitlab # [ 5.996301] systemd[1]: Mounted Kernel Trace File System.755gitlab # [ 5.997620] systemd[1]: Finished Create List of Static Device Nodes.756gitlab # [ 5.998746] systemd[1]: modprobe@configfs.service: Deactivated successfully.757gitlab # [ 6.010244] EXT4-fs (vda): re-mounted 54008c72-d61c-4d70-bc22-ee8127d520f4.758gitlab # [ 5.876431] systemd[1]: Queued start job for default target Multi-User System.759gitlab # [ 6.012972] systemd[1]: Finished Load Kernel Module configfs.760gitlab # [ 5.877750] systemd[1]: Unnecessary job was removed for /dev/vdb.761gitlab # [ 6.014990] systemd[1]: Started Journal Service.762gitlab # [ 5.879316] systemd[1]: systemd-journald.service: Deactivated successfully.763gitlab # [ 5.881089] systemd-modules-load[320]: Using 3 probe threads764gitlab # [ 5.882043] systemd-modules-load[320]: Inserted module 'loop'765gitlab # [ 5.882946] systemd-modules-load[320]: Inserted module 'tls'766gitlab # [ 5.884070] systemd-oomd[322]: No swap; memory pressure usage will be degraded767gitlab # [ 5.885514] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.768gitlab # [ 5.886545] systemd[1]: Mounted FUSE Control File System.769gitlab # [ 5.887460] systemd[1]: Finished Load Kernel Modules.770gitlab # [ 5.888309] systemd[1]: Finished Remount Root and Kernel File Systems.771gitlab # [ 5.889306] systemd[1]: Listening on Disk Image Download Service Socket.772gitlab # [ 5.890200] systemd[1]: Mounting Kernel Configuration File System...773gitlab # [ 5.891069] systemd[1]: Starting Firewall...774gitlab # [ 5.895059] systemd[1]: Starting Flush Journal to Persistent Storage...775gitlab # [ 5.896046] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore776gitlab # [ 5.897437] systemd[1]: Starting Load/Save OS Random Seed...777gitlab # [ 5.898377] systemd[1]: Starting Apply Kernel Variables...778gitlab # [ 5.899277] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...779gitlab # [ 5.900534] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os780gitlab # [ 5.902036] systemd[1]: Mounted Kernel Configuration File System.781gitlab # [ 6.049691] systemd-journald[319]: Received client request to flush runtime journal.782gitlab # [ 5.953718] systemd[1]: Finished Apply Kernel Variables.783gitlab # [ 5.955369] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.784gitlab # [ 5.957150] systemd[1]: Finished Load/Save OS Random Seed.785gitlab # [ 5.957990] systemd[1]: Reached target First Boot Complete.786gitlab # [ 5.959497] systemd[1]: Starting Create Static Device Nodes in /dev...787gitlab # [ 5.960426] systemd[1]: Finished Create Static Device Nodes in /dev.788gitlab # [ 5.961290] systemd[1]: Reached target Preparation for Local File Systems.789gitlab # [ 5.962245] systemd[1]: Starting Rule-based Manager for Device Events and Files...790gitlab # [ 5.963213] systemd[1]: Finished Flush Journal to Persistent Storage.791gitlab # [ 5.970470] systemd-udevd[360]: Using default interface naming scheme 'v261'.792gitlab # [ 6.002549] systemd[1]: Started Rule-based Manager for Device Events and Files.793gitlab # [ 6.013287] systemd[1]: Finished Coldplug All udev Devices.794gitlab # [ 6.074384] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse795gitlab # [ 6.093427] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.796gitlab # [ 6.125382] (udev-worker)[442]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.797gitlab # [ 6.128221] (udev-worker)[442]: Network interface NamePolicy= disabled on kernel command line.798gitlab # [ 6.129421] systemd[1]: Finished Firewall.799gitlab # [ 6.130106] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.800gitlab # [ 6.134993] (udev-worker)[425]: Network interface NamePolicy= disabled on kernel command line.801gitlab # [ 6.157073] systemd[1]: Condition check resulted in Virtio network device being skipped.802gitlab # [ 6.158315] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore803gitlab # [ 6.159721] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67804gitlab # [ 6.161656] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore805gitlab # [ 6.163134] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os806gitlab # [ 6.164710] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os807gitlab # [ 6.305484] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3808gitlab # [ 6.313055] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0809gitlab # [ 6.314669] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD810gitlab # [ 6.317055] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console811gitlab # [ 6.330143] Console: switching to colour dummy device 80x25812gitlab # [ 6.330830] [drm] Found bochs VGA, ID 0xb0c5.813gitlab # [ 6.331460] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.814gitlab # [ 6.332360] ACPI: button: Power Button [PWRF]815gitlab # [ 6.337614] rtc_cmos 00:05: RTC can wake from S4816gitlab # [ 6.340179] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic817gitlab # [ 6.341204] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0818gitlab # [ 6.343309] parport_pc 00:03: reported by Plug and Play ACPI819gitlab # [ 6.344622] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]820gitlab # [ 6.346596] rtc_cmos 00:05: registered as rtc0821gitlab # [ 6.346682] rtc_cmos 00:05: setting system clock to 2026-08-20T08:49:17 UTC (1787215757)822gitlab # [ 6.346786] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs823gitlab # [ 6.351959] systemd-journald[319]: Time jumped backwards, rotating.824gitlab # [ 6.353282] Console: switching to colour frame buffer device 160x50825gitlab # [ 6.354513] Floppy drive(s): fd0 is 2.88M AMI BIOS826gitlab # [ 6.359003] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device827gitlab # [ 6.365814] FDC 0 is a S82078B828gitlab # [ 6.382188] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input4829gitlab # [ 6.407280] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6830gitlab # [ 6.408731] mousedev: PS/2 mouse device common for all mice831gitlab # [ 6.430873] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5832gitlab # [ 6.339145] systemd[1]: Starting Virtual Console Setup...833gitlab # [ 6.355977] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.834gitlab # [ 6.357198] systemd[1]: Stopped Virtual Console Setup.835gitlab # [ 6.363883] systemd[1]: Starting Virtual Console Setup...836gitlab # [ 6.372210] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.837gitlab # [ 6.375626] systemd[1]: Stopped Virtual Console Setup.838gitlab # [ 6.392435] systemd[1]: Starting Virtual Console Setup...839gitlab # [ 6.553630] ppdev: user-space parallel port driver840gitlab # [ 6.557227] kvm_amd: TSC scaling supported841gitlab # [ 6.557781] kvm_amd: Nested Virtualization enabled842gitlab # [ 6.558434] kvm_amd: Nested Paging enabled843gitlab # [ 6.558993] kvm_amd: LBR virtualization supported844gitlab # [ 6.559543] kvm_amd: Virtual VMLOAD VMSAVE supported845gitlab # [ 6.560211] kvm_amd: Virtual GIF supported846gitlab # [ 6.560671] kvm_amd: Virtual NMI enabled847gitlab # [ 6.593597] EDAC MC: Ver: 3.0.0848gitlab # [ 6.467404] systemd-vconsole-setup[495]: Configuration of first virtual console was skipped, ignoring remaining ones.849gitlab # [ 6.468926] systemd[1]: Finished Virtual Console Setup.850gitlab # [ 6.718927] systemd[1]: Mounting /run/wrappers...851gitlab # [ 6.751943] systemd[1]: Mounted /run/wrappers.852gitlab # [ 6.753936] systemd[1]: Reached target Local File Systems.853gitlab # [ 6.755810] systemd[1]: Listening on Boot Loader Control Service Socket.854gitlab # [ 6.758382] systemd[1]: Starting register-nix-paths.service...855gitlab # [ 6.760683] systemd[1]: Starting Create SUID/SGID Wrappers...856gitlab # [ 6.762800] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.857gitlab # [ 6.765679] systemd[1]: Starting Save Transient machine-id to Disk...858gitlab # [ 6.775256] systemd[1]: Starting Create System Files and Directories...859gitlab # [ 6.803222] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.860gitlab # [ 6.807846] systemd[1]: Finished Save Transient machine-id to Disk.861gitlab # [ 6.825288] systemd[1]: Finished Create System Files and Directories.862gitlab # [ 6.828919] systemd[1]: Starting Rebuild Journal Catalog...863gitlab # [ 6.831149] systemd[1]: Starting Record System Boot/Shutdown in UTMP...864gitlab # [ 6.863046] systemd[1]: Finished Record System Boot/Shutdown in UTMP.865gitlab # [ 6.878281] systemd[1]: Finished Rebuild Journal Catalog.866gitlab # [ 6.881511] systemd[1]: Starting Update is Completed...867gitlab # [ 6.898896] systemd[1]: Finished Update is Completed.868gitlab # [ 6.935713] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.869gitlab # [ 6.936769] systemd[1]: Finished Create SUID/SGID Wrappers.870gitlab # [ 7.145905] systemd[1]: Finished register-nix-paths.service.871gitlab # [ 7.147549] systemd[1]: Reached target System Initialization.872gitlab # [ 7.149113] systemd[1]: Started Discard unused filesystem blocks once a week.873gitlab # [ 7.150983] systemd[1]: Started logrotate.timer.874gitlab # [ 7.152208] systemd[1]: Started Daily Cleanup of Temporary Directories.875gitlab # [ 7.153881] systemd[1]: Reached target Timer Units.876gitlab # [ 7.155116] systemd[1]: Listening on D-Bus System Message Bus Socket.877gitlab # [ 7.156728] systemd[1]: Listening on Nix Daemon Socket.878gitlab # [ 7.158079] systemd[1]: Starting nixbot CI service socket...879gitlab # [ 7.159495] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.880gitlab # [ 7.161643] systemd[1]: Listening on nixbot CI service socket.881gitlab # [ 7.163145] systemd[1]: Reached target Socket Units.882gitlab # [ 7.164904] systemd[1]: Starting D-Bus System Message Bus...883gitlab # [ 7.226872] dbus-broker-launch[577]: Looking up NSS user entry for 'systemd-timesync'...884gitlab # [ 7.229911] dbus-broker-launch[577]: NSS returned no entry for 'systemd-timesync'885gitlab # [ 7.232475] dbus-broker-launch[577]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"886gitlab # [ 7.238250] systemd[1]: Started D-Bus System Message Bus.887gitlab # [ 7.250308] dbus-broker-launch[577]: Ready888gitlab # [ 7.252717] systemd[1]: Reached target Basic System.889gitlab # [ 7.255623] systemd[1]: Started backdoor.service.890gitlab # [ 7.258346] systemd[1]: Starting gitlab-config.service...891gitlab # [ 7.262642] systemd[1]: Starting Import lastlog data into lastlog2 database...892gitlab # [ 7.278273] systemd[1]: Starting Logrotate configuration check...893gitlab # [ 7.283525] systemd[1]: Starting Name Service Cache Daemon (nsncd)...894gitlab # [ 7.291507] systemd[1]: Starting Post-Boot Actions...895gitlab # [ 7.294483] systemd[1]: Started Reset console on configuration changes.896gitlab # [ 7.298459] systemd[1]: Starting resolvconf update...897gitlab # connecting to host...898gitlab # [ 7.319291] systemd[1]: Finished Post-Boot Actions.899gitlab # [ 7.325618] systemd[1]: Finished Import lastlog data into lastlog2 database.900gitlab # [ 7.326881] logrotate[582]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.901gitlab: Guest shell says: b'Spawning backdoor root shell...\n'902gitlab # [ 7.328802] logrotate[582]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf903gitlab # [ 7.330108] logrotate[582]: note: 'monthly' overrides previously specified 'weekly'904gitlab: connected to guest root shell905gitlab # [ 7.331074] logrotate[582]: Reading state from file: /var/lib/logrotate.status906gitlab: (connecting took 7.94 seconds)907gitlab # [ 7.331964] logrotate[582]: state file /var/lib/logrotate.status does not exist908gitlab: (finished: waiting for the VM to finish booting, in 7.94 seconds)909gitlab # [ 7.333020] logrotate[582]: Allocating hash table for state file, size 64 entries910gitlab # [ 7.333994] logrotate[582]: Handling 4 logs911gitlab # [ 7.334539] logrotate[582]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed912gitlab # [ 7.336308] logrotate[582]: considering log /var/log/btmp913gitlab # [ 7.336993] logrotate[582]: Creating new state914gitlab # [ 7.338142] logrotate[582]: Now: 2026-08-20 08:49915gitlab # [ 7.338719] logrotate[582]: Last rotated at 2026-08-20 08:00916gitlab # [ 7.339567] logrotate[582]: log does not need rotating (log has already been rotated)917gitlab # [ 7.340103] logrotate[582]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed918gitlab # [ 7.340521] logrotate[582]: considering log /var/log/wtmp919gitlab # [ 7.341044] logrotate[582]: Creating new state920gitlab # [ 7.341443] logrotate[582]: Now: 2026-08-20 08:49921gitlab # [ 7.341859] logrotate[582]: Last rotated at 2026-08-20 08:00922gitlab # [ 7.342474] logrotate[582]: log does not need rotating (log has already been rotated)923gitlab # [ 7.342973] logrotate[582]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed924gitlab # [ 7.343565] logrotate[582]: switching euid from 0 to 165 and egid from 0 to 165 (pid 582)925gitlab # [ 7.343975] logrotate[582]: considering log /var/gitlab/state/log/*.log926gitlab # [ 7.346495] logrotate[582]: log /var/gitlab/state/log/*.log does not exist -- skipping927gitlab # [ 7.347031] logrotate[582]: Creating new state928gitlab # [ 7.347423] logrotate[582]: switching euid from 165 to 0 and egid from 165 to 0 (pid 582)929gitlab # [ 7.347851] logrotate[582]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed930gitlab # [ 7.348421] logrotate[582]: switching euid from 0 to 60 and egid from 0 to 60 (pid 582)931gitlab # [ 7.348898] logrotate[582]: considering log /var/log/nginx/*.log932gitlab # [ 7.349320] logrotate[582]: log /var/log/nginx/*.log does not exist -- skipping933gitlab # [ 7.349767] logrotate[582]: Creating new state934gitlab # [ 7.350364] logrotate[582]: not running postrotate script, since no logs were rotated935gitlab # [ 7.350761] logrotate[582]: switching euid from 60 to 0 and egid from 60 to 0 (pid 582)936gitlab # [ 7.351564] systemd[1]: Finished Logrotate configuration check.937gitlab # [ 7.357963] nsncd[583]: Aug 20 08:49:18.646 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"938gitlab # [ 7.360818] systemd[1]: Started Name Service Cache Daemon (nsncd).939gitlab # [ 7.361972] systemd[1]: Reached target Host and Network Name Lookups.940gitlab # [ 7.362604] systemd[1]: Reached target User and Group Name Lookups.941gitlab # [ 7.365926] systemd[1]: Starting User Login Management...942gitlab # [ 7.388073] systemd[1]: Stopped target Host and Network Name Lookups.943gitlab # [ 7.388680] systemd[1]: Stopping Host and Network Name Lookups...944gitlab # [ 7.389370] systemd[1]: Stopped target User and Group Name Lookups.945gitlab # [ 7.390174] systemd[1]: Stopping User and Group Name Lookups...946gitlab # [ 7.391745] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...947gitlab # [ 7.394811] systemd[1]: nscd.service: Deactivated successfully.948gitlab # [ 7.395631] systemd[1]: Stopped Name Service Cache Daemon (nsncd).949gitlab # [ 7.396688] systemd[1]: nscd.service: Consumed 37ms CPU time over 112ms wall clock time, 7.1M memory peak, 5.5M read from disk.950gitlab # [ 7.399531] systemd[1]: Starting Name Service Cache Daemon (nsncd)...951gitlab # [ 7.406076] systemd-logind[641]: New seat seat0.952gitlab # [ 7.412525] systemd-logind[641]: Watching system buttons on /dev/input/event2 (Power Button)953gitlab # [ 7.413214] systemd-logind[641]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)954gitlab # [ 7.413696] systemd-logind[641]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)955gitlab # [ 7.416858] systemd[1]: Started User Login Management.956gitlab # [ 7.419453] systemd[1]: Starting linger-users.service...957gitlab # [ 7.420938] nsncd[672]: Aug 20 08:49:18.709 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"958gitlab # [ 7.421541] systemd[1]: Started Name Service Cache Daemon (nsncd).959gitlab # [ 7.423597] systemd[1]: Reached target Host and Network Name Lookups.960gitlab # [ 7.424147] systemd[1]: Reached target User and Group Name Lookups.961gitlab # [ 7.430479] systemd[1]: Finished resolvconf update.962gitlab # [ 7.431734] systemd[1]: Reached target Preparation for Network.963gitlab # [ 7.434695] systemd[1]: Starting DHCP Client...964gitlab # [ 7.436671] systemd[1]: Starting Address configuration of eth1...965gitlab # [ 7.439068] systemd[1]: Starting Extra networking commands....966gitlab # [ 7.439664] systemd[1]: linger-users.service: Deactivated successfully.967gitlab # [ 7.444521] systemd[1]: Finished linger-users.service.968gitlab # [ 7.462890] network-addresses-eth1-start[699]: adding address 192.168.1.1/24... done969gitlab # [ 7.468829] network-addresses-eth1-start[699]: adding address 2001:db8:1::1/64... done970gitlab # [ 7.475447] systemd[1]: Finished Address configuration of eth1.971gitlab # [ 7.502549] systemd[1]: Finished Extra networking commands..972gitlab # [ 7.503739] systemd[1]: Reached target Network.973gitlab # [ 7.505759] dhcpcd[714]: dhcpcd-10.3.2 starting974gitlab # [ 7.506773] systemd[1]: Starting gitlab-workhorse.service...975gitlab # [ 7.508087] dhcpcd[765]: dev: loaded udev976gitlab # [ 7.509568] systemd[1]: Starting Nginx Web Server...977gitlab # [ 7.649305] 8021q: 802.1Q VLAN Support v1.8978gitlab # [ 7.649743] 8021q: adding VLAN 0 to HW filter on device eth1979gitlab # [ 7.514826] systemd[1]: Starting PostgreSQL Server...980gitlab # [ 7.516159] systemd[1]: Starting Redis Server - redis-gitlab...981gitlab # [ 7.517967] systemd[1]: Starting Permit User Sessions...982gitlab # [ 7.528567] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.983gitlab # [ 7.540068] systemd[1]: Finished Permit User Sessions.984gitlab # [ 7.541814] systemd[1]: Started Getty on tty1.985gitlab # [ 7.543508] systemd[1]: Reached target Login Prompts.986gitlab # [ 7.731116] cfg80211: Loading compiled-in X.509 certificates for regulatory database987gitlab # [ 7.735244] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'988gitlab # [ 7.736070] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'989gitlab # [ 7.737784] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2990gitlab # [ 7.738964] cfg80211: failed to load regulatory.db991gitlab # [ 7.766690] 8021q: adding VLAN 0 to HW filter on device eth0992gitlab # [ 7.632766] dhcpcd[765]: eth0: waiting for carrier993gitlab # [ 7.633791] dhcpcd[765]: eth0: carrier acquired994gitlab # [ 7.638216] dhcpcd[765]: DUID 00:01:00:01:32:19:7c:0e:52:54:00:12:34:56995gitlab # [ 7.639087] dhcpcd[765]: eth0: IAID 00:12:34:56996gitlab # [ 7.639735] dhcpcd[765]: eth0: adding address fe80::5054:ff:fe12:3456997gitlab # [ 7.657282] postgresql-pre-start[793]: The files belonging to this database system will be owned by user "postgres".998gitlab # [ 7.657842] postgresql-pre-start[793]: This user must also own the server process.999gitlab # [ 7.660367] redis-server[788]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.1000gitlab # [ 7.661155] redis-server[788]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo1001gitlab # [ 7.661543] redis-server[788]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=788, just started1002gitlab # [ 7.662050] redis-server[788]: Configuration loaded1003gitlab # [ 7.662658] redis[788]: monotonic clock: POSIX clock_gettime1004gitlab # [ 7.663484] redis[788]: Running mode=standalone, port=0.1005gitlab # [ 7.664293] redis[788]: Server initialized1006gitlab # [ 7.665057] postgresql-pre-start[793]: The database cluster will be initialized with locale "en_US.UTF-8".1007gitlab # [ 7.665783] postgresql-pre-start[793]: The default database encoding has accordingly been set to "UTF8".1008gitlab # [ 7.666319] postgresql-pre-start[793]: The default text search configuration will be set to "english".1009gitlab # [ 7.666875] postgresql-pre-start[793]: Data page checksums are enabled.1010gitlab # [ 7.667580] postgresql-pre-start[793]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok1011gitlab # [ 7.669163] postgresql-pre-start[793]: creating subdirectories ... ok1012gitlab # [ 7.669730] postgresql-pre-start[793]: selecting dynamic shared memory implementation ... posix1013gitlab # [ 7.670620] systemd[1]: Started Redis Server - redis-gitlab.1014gitlab # [ 7.671695] redis[788]: Ready to accept connections unix1015gitlab # [ 7.673340] redis[788]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1016gitlab # [ 7.679420] nginx-pre-start[797]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok1017gitlab # [ 7.681218] nginx-pre-start[797]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful1018gitlab # [ 7.685988] systemd[1]: Started Nginx Web Server.1019gitlab # [ 7.695919] postgresql-pre-start[793]: selecting default "max_connections" ... 1001020gitlab # [ 7.731050] postgresql-pre-start[793]: selecting default "shared_buffers" ... 128MB1021gitlab # [ 8.000100] systemd[1]: Started gitlab-workhorse.service.1022gitlab # [ 8.069876] postgresql-pre-start[793]: selecting default time zone ... UTC1023gitlab # [ 8.072588] postgresql-pre-start[793]: creating configuration files ... ok1024gitlab # [ 8.211132] gitlab-workhorse[824]: time="2026-08-20T08:49:19Z" level=info msg=Starting build_time=19700101.000000 version=19.0.41025gitlab # [ 8.211535] gitlab-workhorse[824]: time="2026-08-20T08:49:19Z" level=info msg="Using redis/go-redis"1026gitlab # [ 8.211973] gitlab-workhorse[824]: time="2026-08-20T08:49:19Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1027gitlab # [ 8.229653] postgresql-pre-start[793]: running bootstrap script ... ok1028gitlab # [ 8.672765] postgresql-pre-start[793]: performing post-bootstrap initialization ... ok1029gitlab # [ 8.833518] dhcpcd[765]: eth0: soliciting a DHCP lease1030gitlab # [ 8.981778] NET: Registered PF_PACKET protocol family1031gitlab # [ 8.856240] dhcpcd[765]: eth0: offered 10.0.2.15 from 10.0.2.21032gitlab # [ 8.859403] dhcpcd[765]: eth0: probing address 10.0.2.15/241033gitlab # [ 8.949533] postgresql-pre-start[793]: syncing data to disk ... ok1034gitlab # [ 8.950580] postgresql-pre-start[793]: initdb: warning: enabling "trust" authentication for local connections1035gitlab # [ 8.951413] postgresql-pre-start[793]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1036gitlab # [ 8.952104] postgresql-pre-start[793]: Success. You can now start the database server using:1037gitlab # [ 8.952775] postgresql-pre-start[793]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1038gitlab # [ 9.043577] postgres[852]: [852] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1039gitlab # [ 9.046428] postgres[852]: [852] LOG: listening on IPv6 address "::1", port 54321040gitlab # [ 9.047897] postgres[852]: [852] LOG: listening on IPv4 address "127.0.0.1", port 54321041gitlab # [ 9.054181] postgres[852]: [852] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1042gitlab # [ 9.067892] postgres[861]: [861] LOG: database system was shut down at 2026-08-20 08:49:19 GMT1043gitlab # [ 9.074725] postgres[852]: [852] LOG: database system is ready to accept connections1044gitlab # [ 9.084423] systemd[1]: Started PostgreSQL Server.1045gitlab # [ 9.085780] systemd[1]: Starting PostgreSQL Setup Scripts...1046gitlab # [ 9.275800] postgresql-setup-start[872]: CREATE DATABASE1047gitlab # [ 9.306326] postgresql-setup-start[882]: CREATE ROLE1048gitlab # [ 9.316479] postgresql-setup-start[884]: ALTER DATABASE1049gitlab # [ 9.341844] postgresql-setup-start[889]: CREATE ROLE1050gitlab # [ 9.344461] systemd[1]: Finished PostgreSQL Setup Scripts.1051gitlab # [ 9.346257] systemd[1]: Reached target PostgreSQL.1052gitlab # [ 9.349741] systemd[1]: Starting gitlab-postgresql.service...1053gitlab # [ 9.397607] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[877]: mkdir -p /var/gitlab/state/home/.ssh: OK1054gitlab # [ 9.400677] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[877]: chmod 700 /var/gitlab/state/home/.ssh: OK1055gitlab # [ 9.448106] systemd[1]: Finished gitlab-config.service.1056gitlab # [ 9.449976] systemd[1]: Started gitaly.service.1057gitlab # [ 9.452201] systemd[1]: Starting gitlab-db-config.service...1058gitlab # [ 9.455770] gitlab-postgresql-start[897]: CREATE DATABASE1059gitlab # [ 9.481895] gitlab-postgresql-start[925]: CREATE EXTENSION1060gitlab # [ 9.559769] gitlab-postgresql-start[928]: CREATE EXTENSION1061gitlab # [ 9.563472] systemd[1]: Finished gitlab-postgresql.service.1062gitlab # [ 9.965278] gitaly[920]: time="2026-08-20T08:49:21.250Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=9201063gitlab # [ 9.966405] gitaly[920]: time="2026-08-20T08:49:21.251Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=9201064gitlab # [ 9.967624] gitaly[920]: time="2026-08-20T08:49:21.251Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=9201065gitlab # [ 9.968471] gitaly[920]: time="2026-08-20T08:49:21.251Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=9201066gitlab # [ 9.969128] gitaly[920]: time="2026-08-20T08:49:21.251Z" level=info msg="Starting Gitaly" pid=920 version=1067gitlab # [ 10.069527] dhcpcd[765]: eth0: soliciting an IPv6 router1068gitlab # [ 10.071117] dhcpcd[765]: eth0: Router Advertisement from fe80::21069gitlab # [ 10.071975] dhcpcd[765]: eth0: adding address fec0::5054:ff:fe12:3456/641070gitlab # [ 10.072551] dhcpcd[765]: eth0: adding route to fec0::/641071gitlab # [ 10.073056] dhcpcd[765]: eth0: adding default route via fe80::21072gitlab # [ 10.146702] gitaly[920]: time="2026-08-20T08:49:21.435Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=183 pid=9201073gitlab # [ 10.147561] gitaly[920]: time="2026-08-20T08:49:21.435Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=9201074gitlab # [ 10.148101] gitaly[920]: time="2026-08-20T08:49:21.436Z" level=info msg="finished initializing command factory" duration_ms=0 pid=9201075gitlab # [ 10.148237] gitaly[920]: time="2026-08-20T08:49:21.436Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-920/git-exec-980997337.d/git pid=9201076gitlab # [ 10.151272] gitaly[920]: time="2026-08-20T08:49:21.440Z" level=info msg="finished detecting git version" duration_ms=4 pid=9201077gitlab # [ 10.152134] gitaly[920]: time="2026-08-20T08:49:21.440Z" level=info msg="using Git version" pid=920 version=2.53.g1078gitlab # [ 10.152888] gitaly[920]: time="2026-08-20T08:49:21.440Z" level=info msg="clearing disk cache object folder" pid=920 storage=default1079gitlab # [ 10.153450] gitaly[920]: time="2026-08-20T08:49:21.441Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2447621388 pid=920 storage=default1080gitlab # [ 10.153899] gitaly[920]: time="2026-08-20T08:49:21.441Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2447621388 pid=920 storage=default1081gitlab # [ 10.154755] gitaly[920]: time="2026-08-20T08:49:21.441Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=9201082gitlab # [ 10.155683] gitaly[920]: time="2026-08-20T08:49:21.441Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=9201083gitlab # [ 10.156210] gitaly[920]: time="2026-08-20T08:49:21.441Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2447621388 clear_duration_ms=0 pid=920 storage=default1084gitlab # [ 10.202486] gitaly[920]: time="2026-08-20T08:49:21.491Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=9201085gitlab # [ 10.203023] gitaly[920]: time="2026-08-20T08:49:21.491Z" level=info msg="counting repositories" pid=9201086gitlab # [ 10.203494] gitaly[920]: time="2026-08-20T08:49:21.491Z" level=info msg="starting to count repositories" pid=920 storage_path=/var/gitlab/state/repositories1087gitlab # [ 10.204066] gitaly[920]: time="2026-08-20T08:49:21.491Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=920 schema=unix1088gitlab # [ 10.204575] gitaly[920]: time="2026-08-20T08:49:21.491Z" level=info msg="finished tempdir cleaner walk" pid=920 storage=default time_ms=01089gitlab # [ 10.205165] gitaly[920]: time="2026-08-20T08:49:21.491Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=920 storage_path=/var/gitlab/state/repositories1090gitlab # [ 10.205613] gitaly[920]: time="2026-08-20T08:49:21.491Z" level=info msg="listening at address" address=/run/gitaly/gitaly-920/sock.d/intern pid=920 schema=unix1091gitlab # [ 10.206163] gitaly[920]: time="2026-08-20T08:49:21.491Z" level=info msg="completed counting all repositories" counting_duration=0 pid=9201092gitlab # [ 10.217666] gitaly[920]: time="2026-08-20T08:49:21.506Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9201093gitlab # [ 10.218466] gitaly[920]: time="2026-08-20T08:49:21.506Z" level=info msg="Started Gitaly" duration_ms=255 pid=9201094gitlab # [ 10.219218] gitaly[920]: time="2026-08-20T08:49:21.506Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9201095gitlab # [ 10.219900] gitaly[920]: time="2026-08-20T08:49:21.507Z" level=info msg="maintenance: daily scheduled" pid=920 scheduled="2026-08-20 12:00:00 +0000 UTC"1096gitlab # [ 10.851190] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[926]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1097gitlab # [ 10.853741] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[926]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1098gitlab # [ 10.876255] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[926]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1099gitlab # [ 12.192333] gitaly[920]: time="2026-08-20T08:49:23.480Z" level=info msg="License database preloaded" duration_ms=2229 pid=9201100gitlab # [ 13.542817] dhcpcd[765]: eth0: leased 10.0.2.15 for 86400 seconds1101gitlab # [ 13.543900] dhcpcd[765]: eth0: adding route to 10.0.2.0/241102gitlab # [ 13.544947] dhcpcd[765]: eth0: adding default route via 10.0.2.21103gitlab # [ 13.672830] systemd[1]: Started DHCP Client.1104gitlab # [ 13.674506] systemd[1]: Reached target Network is Online.1105gitlab # [ 41.430506] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[926]: W, [2026-08-20T08:49:52.718821 #926] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1106gitlab # [ 43.186838] postgres[1317]: [1317] ERROR: relation "feature_gates" does not exist at character 5231107gitlab # [ 43.188378] postgres[1317]: [1317] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1108gitlab # [ 43.189608] postgres[1317]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1109gitlab # [ 43.191360] postgres[1317]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1110gitlab # [ 43.192455] postgres[1317]: attidentity AS identity,1111gitlab # [ 43.194306] postgres[1317]: attgenerated as attgenerated1112gitlab # [ 43.195831] postgres[1317]: FROM pg_attribute a1113gitlab # [ 43.197939] postgres[1317]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1114gitlab # [ 43.200138] postgres[1317]: LEFT JOIN pg_type t ON a.atttypid = t.oid1115gitlab # [ 43.201453] postgres[1317]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1116gitlab # [ 43.203280] postgres[1317]: WHERE a.attrelid = '"feature_gates"'::regclass1117gitlab # [ 43.204980] postgres[1317]: AND a.attnum > 0 AND NOT a.attisdropped1118gitlab # [ 43.207073] postgres[1317]: ORDER BY a.attnum1119gitlab # [ 43.208463] postgres[1317]:1120gitlab # [ 47.030291] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1350]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1121gitlab # [ 47.032487] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1350]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1122gitlab # [ 48.255197] gitlab-workhorse[824]: time="2026-08-20T08:49:59Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1123gitlab # [ 58.265368] gitlab-workhorse[824]: time="2026-08-20T08:50:09Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1124gitlab # [ 61.760666] postgres[1425]: [1425] ERROR: relation "table_without_models" does not exist1125gitlab # [ 61.762582] postgres[1425]: [1425] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1126gitlab # [ 68.274889] gitlab-workhorse[824]: time="2026-08-20T08:50:19Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1127gitlab # [ 73.095092] systemd[1]: Finished gitlab-db-config.service.1128gitlab # [ 73.097067] systemd[1]: Started gitlab-sidekiq.service.1129gitlab # [ 73.099184] systemd[1]: Starting gitlab.service...1130gitlab # [ 73.456763] bundle[1583]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1131gitlab # [ 73.458462] bundle[1583]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1132gitlab # [ 73.460074] bundle[1583]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1133gitlab # [ 76.127881] sidekiq-cluster[1582]: {"severity":"INFO","time":"2026-08-20T08:50:27.399Z","message":"Starting cluster with 1 processes"}1134gitlab # [ 76.237780] bundle[1583]: {"timestamp":"2026-08-20T08:50:27.506Z","pid":1583,"message":"* Enabling systemd notification integration"}1135gitlab # [ 76.238819] bundle[1583]: {"timestamp":"2026-08-20T08:50:27.526Z","pid":1583,"message":"Puma starting in cluster mode..."}1136gitlab # [ 76.239639] bundle[1583]: {"timestamp":"2026-08-20T08:50:27.526Z","pid":1583,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1137gitlab # [ 76.240414] bundle[1583]: {"timestamp":"2026-08-20T08:50:27.526Z","pid":1583,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1138gitlab # [ 76.241142] bundle[1583]: {"timestamp":"2026-08-20T08:50:27.526Z","pid":1583,"message":"* Min threads: 0"}1139gitlab # [ 76.241843] bundle[1583]: {"timestamp":"2026-08-20T08:50:27.526Z","pid":1583,"message":"* Max threads: 4"}1140gitlab # [ 76.242635] bundle[1583]: {"timestamp":"2026-08-20T08:50:27.526Z","pid":1583,"message":"* Environment: production"}1141gitlab # [ 76.243285] bundle[1583]: {"timestamp":"2026-08-20T08:50:27.526Z","pid":1583,"message":"* Master PID: 1583"}1142gitlab # [ 76.243968] bundle[1583]: {"timestamp":"2026-08-20T08:50:27.526Z","pid":1583,"message":"* Workers: 2"}1143gitlab # [ 76.244559] bundle[1583]: {"timestamp":"2026-08-20T08:50:27.526Z","pid":1583,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1144gitlab # [ 76.245203] bundle[1583]: {"timestamp":"2026-08-20T08:50:27.526Z","pid":1583,"message":"* Preloading application"}1145gitlab # [ 78.284955] gitlab-workhorse[824]: time="2026-08-20T08:50:29Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1146gitlab # [ 88.297887] gitlab-workhorse[824]: time="2026-08-20T08:50:39Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1147gitlab # [ 98.308090] gitlab-workhorse[824]: time="2026-08-20T08:50:49Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1148gitlab # [ 98.737702] bundle[1583]: W, [2026-08-20T08:50:50.026069 #1583] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1149gitlab # [ 101.207683] sidekiq-cluster[1613]: 2026-08-20T08:50:52.495Z pid=1613 tid=wkl INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1613, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>432119808}1150gitlab # [ 101.379407] sidekiq-cluster[1613]: W, [2026-08-20T08:50:52.668396 #1613] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1151gitlab # [ 101.417837] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:52.706Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1152gitlab # [ 103.310289] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.598Z","message":"GitLab reliable fetch activated!"}1153gitlab # [ 103.311476] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.598Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1154gitlab # [ 103.332575] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.621Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1155gitlab # [ 103.334593] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.623Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1156gitlab # [ 103.336853] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.625Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1157gitlab # [ 103.338927] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.628Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1158gitlab # [ 103.341270] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.630Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1159gitlab # [ 103.343566] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.632Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1160gitlab # [ 103.345697] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.634Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1161gitlab # [ 103.347437] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.636Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1162gitlab # [ 103.349261] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.638Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1163gitlab # [ 103.351136] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.640Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1164gitlab # [ 103.352934] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.642Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1165gitlab # [ 103.355549] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.644Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1166gitlab # [ 103.357358] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.646Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1167gitlab # [ 103.359277] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.648Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1168gitlab # [ 103.361213] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.650Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1169gitlab # [ 103.363220] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.652Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1170gitlab # [ 103.365873] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.654Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1171gitlab # [ 103.370630] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.659Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1172gitlab # [ 103.374802] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.663Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1173gitlab # [ 103.378812] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.667Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1174gitlab # [ 103.383085] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.672Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1175gitlab # [ 103.387643] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.676Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1176gitlab # [ 103.392499] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.681Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1177gitlab # [ 103.396463] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.685Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1178gitlab # [ 103.400362] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.689Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1179gitlab # [ 103.404372] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.693Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1180gitlab # [ 103.409842] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.698Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1181gitlab # [ 103.416315] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.705Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1182gitlab # [ 103.422396] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.711Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1183gitlab # [ 103.428418] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.717Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1184gitlab # [ 103.433336] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.722Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1185gitlab # [ 103.439446] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.728Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1186gitlab # [ 103.445064] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.734Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1187gitlab # [ 103.451178] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.740Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1188gitlab # [ 103.456840] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.745Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1189gitlab # [ 103.461730] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.750Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1190gitlab # [ 103.467059] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.756Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1191gitlab # [ 103.472762] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.761Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1192gitlab # [ 103.477837] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.766Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1193gitlab # [ 103.483050] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.772Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1194gitlab # [ 103.488611] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.777Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1195gitlab # [ 103.493565] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.782Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1196gitlab # [ 103.498961] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.788Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1197gitlab # [ 103.504384] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.793Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1198gitlab # [ 103.510657] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.799Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1199gitlab # [ 103.515817] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.804Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1200gitlab # [ 103.520933] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.809Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1201gitlab # [ 103.526784] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.815Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1202gitlab # [ 103.532933] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.821Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1203gitlab # [ 103.537867] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.826Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1204gitlab # [ 103.543089] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.832Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1205gitlab # [ 103.548663] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.837Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1206gitlab # [ 103.563558] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.852Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1207gitlab # [ 103.567866] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.856Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1208gitlab # [ 103.571723] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.860Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1209gitlab # [ 103.579432] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.868Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1210gitlab # [ 103.583429] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.872Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1211gitlab # [ 103.588833] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.877Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1212gitlab # [ 103.593551] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.882Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1213gitlab # [ 103.599330] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.888Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1214gitlab # [ 103.603495] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.892Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1215gitlab # [ 103.608299] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.897Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1216gitlab # [ 103.614354] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.903Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1217gitlab # [ 103.619962] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.909Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1218gitlab # [ 103.624346] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.913Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1219gitlab # [ 103.629236] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.918Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1220gitlab # [ 103.632938] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.922Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1221gitlab # [ 103.636370] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.925Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1222gitlab # [ 103.640592] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.929Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1223gitlab # [ 103.644249] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.933Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1224gitlab # [ 103.679118] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.968Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1225gitlab # [ 103.683866] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.971Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1226gitlab # [ 103.689202] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.973Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1227gitlab # [ 103.690446] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.975Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1228gitlab # [ 103.692070] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.977Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1229gitlab # [ 103.693868] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.982Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1230gitlab # [ 103.697955] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.987Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1231gitlab # [ 103.701337] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.990Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1232gitlab # [ 103.704733] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.993Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1233gitlab # [ 103.708390] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:54.997Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1234gitlab # [ 103.711754] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:55.000Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1235gitlab # [ 103.715562] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:55.004Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1236gitlab # [ 103.719460] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:55.008Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1237gitlab # [ 103.722614] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:55.011Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1238gitlab # [ 103.725454] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:55.014Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1239gitlab # [ 103.728337] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:55.017Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1240gitlab # [ 103.730961] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:55.020Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1241gitlab # [ 103.734104] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:55.023Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1242gitlab # [ 103.736484] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:55.025Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1243gitlab # [ 103.739471] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:55.028Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1244gitlab # [ 103.741878] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:55.031Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1245gitlab # [ 103.744338] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:55.033Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1246gitlab # [ 103.747083] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:55.036Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1247gitlab # [ 103.749640] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:55.038Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1248gitlab # [ 103.752890] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:55.042Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1249gitlab # [ 103.755986] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:55.045Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1250gitlab # [ 103.758897] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:55.048Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1251gitlab # [ 103.761210] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:55.050Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1252gitlab # [ 103.770908] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:55.060Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1253gitlab # [ 103.773606] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:55.062Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1254gitlab # [ 103.776275] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:55.065Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1255gitlab # [ 103.779433] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:55.068Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1256gitlab # [ 103.782769] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:55.071Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1257gitlab # [ 103.785481] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:55.074Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1258gitlab # [ 103.788082] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:55.077Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1259gitlab # [ 103.789908] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:55.079Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1260gitlab # [ 103.792189] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:55.081Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1261gitlab # [ 103.795085] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:55.084Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1262gitlab # [ 103.796882] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:50:55.086Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1263gitlab # [ 108.317878] gitlab-workhorse[824]: time="2026-08-20T08:50:59Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1264gitlab # [ 118.327950] gitlab-workhorse[824]: time="2026-08-20T08:51:09Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1265gitlab # [ 128.329598] gitlab-workhorse[824]: time="2026-08-20T08:51:19Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1266gitlab # [ 128.491167] postgres[2060]: [2060] ERROR: relation "table_without_models" does not exist1267gitlab # [ 128.492294] postgres[2060]: [2060] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1268gitlab # [ 129.414038] postgres[2071]: [2071] ERROR: relation "table_without_models" does not exist1269gitlab # [ 129.415163] postgres[2071]: [2071] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1270gitlab # [ 131.241773] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:22.529Z","message":"Booted Rails 7.2.3.1 application in production environment"}1271gitlab # [ 131.243356] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:22.531Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1272gitlab # [ 131.247912] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:22.531Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1273gitlab # [ 131.252132] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:22.531Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1274gitlab # [ 131.253584] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:22.536Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1275gitlab # [ 132.153401] bundle[1583]: {"timestamp":"2026-08-20T08:51:23.441Z","pid":1583,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1276gitlab # [ 132.155551] bundle[1583]: {"timestamp":"2026-08-20T08:51:23.441Z","pid":1583,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1277gitlab # [ 132.156907] bundle[1583]: {"timestamp":"2026-08-20T08:51:23.441Z","pid":1583,"message":"! #\u003cThread:0x00007f8086f19920 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1278gitlab # [ 132.158099] bundle[1583]: {"timestamp":"2026-08-20T08:51:23.441Z","pid":1583,"message":"! #\u003cThread:0x00007f80871ab030 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1279gitlab # [ 132.159064] bundle[1583]: {"timestamp":"2026-08-20T08:51:23.441Z","pid":1583,"message":"Use Ctrl-C to stop"}1280gitlab # [ 132.160177] bundle[1583]: {"timestamp":"2026-08-20T08:51:23.442Z","pid":1583,"message":"Sending status to systemd every 1.0 sec"}1281gitlab # [ 132.558107] bundle[1583]: {"timestamp":"2026-08-20T08:51:23.846Z","pid":1583,"message":"- Worker 0 (PID: 2156) booted in 0.34s, phase: 0"}1282gitlab # [ 132.560339] bundle[1583]: {"timestamp":"2026-08-20T08:51:23.849Z","pid":1583,"message":"- Worker 1 (PID: 2160) booted in 0.33s, phase: 0"}1283gitlab # [ 132.568069] systemd[1]: Started gitlab.service.1284gitlab # [ 132.570070] systemd[1]: Reached target Common target for all GitLab services..1285gitlab # [ 132.575356] systemd[1]: Starting setup-gitlab.service...1286gitlab # [ 132.591116] setup-gitlab-start[2193]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1287gitlab # [ 132.729885] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:24.018Z","message":"Cleaning working queues"}1288gitlab # [ 132.733360] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:24.020Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"c803bdd22d652e9324fa0a5a","created_at":"2026-08-20T08:50:24.054Z","trace_propagation_headers":{"sentry-trace":"91e831e059df45e9ad863cde2d3696b9-29c111f930cf4287","baggage":"sentry-trace_id=91e831e059df45e9ad863cde2d3696b9,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"c0d1ff4d39dd0a6dce2d4a5d8f513788","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T08:50:24.062Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-c803bdd22d652e9324fa0a5a: start","job_status":"start","queue_duration_s":59.957989,"scheduling_latency_s":59.958058}1289gitlab # [ 132.883211] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:24.171Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"c803bdd22d652e9324fa0a5a","created_at":"2026-08-20T08:50:24.054Z","trace_propagation_headers":{"sentry-trace":"91e831e059df45e9ad863cde2d3696b9-29c111f930cf4287","baggage":"sentry-trace_id=91e831e059df45e9ad863cde2d3696b9,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"c0d1ff4d39dd0a6dce2d4a5d8f513788","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T08:50:24.062Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-c803bdd22d652e9324fa0a5a: done: 0.151827 sec","job_status":"done","queue_duration_s":59.957989,"scheduling_latency_s":59.958058,"redis_calls":24,"redis_duration_s":0.004619,"redis_read_bytes":912,"redis_write_bytes":2622,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.00202,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001515,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001084,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":9,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.074518,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.082469141,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.151827,"completed_at":"2026-08-20T08:51:24.171Z","load_balancing_strategy":"primary","db_duration_s":0.039217,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1290gitlab # [ 134.851961] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:51:26 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 22341291gitlab # [ 134.856843] setup-gitlab-start[2193]: + TOKEN=nixbot-test-token-of-20-chars1292gitlab # [ 134.859328] setup-gitlab-start[2193]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1293gitlab # [ 134.871169] runuser[2218]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1294gitlab # [ 135.243877] setup-gitlab-start[2219]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1295gitlab # [ 135.248522] setup-gitlab-start[2219]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1296gitlab # [ 135.253065] setup-gitlab-start[2219]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1297gitlab # [ 135.841920] setup-gitlab-start[2219]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1298gitlab # [ 135.846595] setup-gitlab-start[2219]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1299gitlab # [ 135.851055] setup-gitlab-start[2219]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1300gitlab # [ 144.241219] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:35.529Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"408c71b0eb181a4ab7cfbf89","created_at":"2026-08-20T08:51:35.499Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e335e0d1458bde39ccbba87e57f81416","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T08:51:35.527Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-408c71b0eb181a4ab7cfbf89: start","job_status":"start","queue_duration_s":0.002019,"scheduling_latency_s":0.002058}1301gitlab # [ 144.301490] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:35.589Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"408c71b0eb181a4ab7cfbf89","created_at":"2026-08-20T08:51:35.499Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e335e0d1458bde39ccbba87e57f81416","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T08:51:35.527Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-408c71b0eb181a4ab7cfbf89: done: 0.060789 sec","job_status":"done","queue_duration_s":0.002019,"scheduling_latency_s":0.002058,"redis_calls":12,"redis_duration_s":0.011093,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001466,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004018,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.005609,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019746,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000971073,"exclusive_lock_hold_duration_s":0.007345905,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.060789,"completed_at":"2026-08-20T08:51:35.589Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007521,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1302gitlab # [ 144.365665] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:35.654Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"158643be103f9f409a16d6a7","created_at":"2026-08-20T08:51:35.537Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dbb8f3adcf008cf504889b81e7acddde","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T08:51:35.551Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-158643be103f9f409a16d6a7: start","job_status":"start","queue_duration_s":0.102948,"scheduling_latency_s":0.102969}1303gitlab # [ 144.381613] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:35.670Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1304gitlab # [ 144.397670] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:35.686Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"158643be103f9f409a16d6a7","created_at":"2026-08-20T08:51:35.537Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dbb8f3adcf008cf504889b81e7acddde","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T08:51:35.551Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-158643be103f9f409a16d6a7: done: 0.032038 sec","job_status":"done","queue_duration_s":0.102948,"scheduling_latency_s":0.102969,"redis_calls":10,"redis_duration_s":0.007442999999999999,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000819,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004813,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001811,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008025,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001171378,"duration_s":0.032038,"completed_at":"2026-08-20T08:51:35.686Z","load_balancing_strategy":"primary","db_duration_s":0.000916,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1305gitlab # [ 144.416057] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:35.690Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"124d366078cd2d8f7a65952a","created_at":"2026-08-20T08:51:35.565Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4b98c08a6e391bfb3a7c7e55a2fb7bf9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T08:51:35.599Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-124d366078cd2d8f7a65952a: start","job_status":"start","queue_duration_s":0.090811,"scheduling_latency_s":0.090825}1306gitlab # [ 144.472658] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:35.761Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1307gitlab # [ 144.489101] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:35.777Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"124d366078cd2d8f7a65952a","created_at":"2026-08-20T08:51:35.565Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4b98c08a6e391bfb3a7c7e55a2fb7bf9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T08:51:35.599Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-124d366078cd2d8f7a65952a: done: 0.087835 sec","job_status":"done","queue_duration_s":0.090811,"scheduling_latency_s":0.090825,"redis_calls":10,"redis_duration_s":0.009843000000000001,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001155,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006413,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002275,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01434,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001627023,"duration_s":0.087835,"completed_at":"2026-08-20T08:51:35.777Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008693,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1308gitlab # [ 144.525285] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:35.814Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"85723bd15f5d5a7dea31f78b","created_at":"2026-08-20T08:51:35.607Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"73e75a0c0fbcfc7c40b32d4186e382f6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T08:51:35.613Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-85723bd15f5d5a7dea31f78b: start","job_status":"start","queue_duration_s":0.200664,"scheduling_latency_s":0.200684}1309gitlab # [ 144.582525] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:35.871Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1310gitlab # [ 144.614541] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:35.902Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"85723bd15f5d5a7dea31f78b","created_at":"2026-08-20T08:51:35.607Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"73e75a0c0fbcfc7c40b32d4186e382f6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T08:51:35.613Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-85723bd15f5d5a7dea31f78b: done: 0.088912 sec","job_status":"done","queue_duration_s":0.200664,"scheduling_latency_s":0.200684,"redis_calls":10,"redis_duration_s":0.009292,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001707,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004298,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003287,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016837,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00091548,"duration_s":0.088912,"completed_at":"2026-08-20T08:51:35.902Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.020746,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1311gitlab # [ 144.674332] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:35.963Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"7228b7850dbe287223a5f1b8","created_at":"2026-08-20T08:51:35.641Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"46bdb8e75bf75b2bace187aaec027768","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T08:51:35.649Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-7228b7850dbe287223a5f1b8: start","job_status":"start","queue_duration_s":0.313425,"scheduling_latency_s":0.313453}1312gitlab # [ 144.760181] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:36.048Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"7228b7850dbe287223a5f1b8","created_at":"2026-08-20T08:51:35.641Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"46bdb8e75bf75b2bace187aaec027768","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T08:51:35.649Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-7228b7850dbe287223a5f1b8: done: 0.085471 sec","job_status":"done","queue_duration_s":0.313425,"scheduling_latency_s":0.313453,"redis_calls":13,"redis_duration_s":0.017959,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000862,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.013844,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003253,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026866,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.018072688,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.085471,"completed_at":"2026-08-20T08:51:36.048Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02057,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1313gitlab # [ 144.796062] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:36.059Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"b76bd55d4f3d10cf9dd950c8","created_at":"2026-08-20T08:51:35.656Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"42084f0509838b70251cf1d61f5ade5c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T08:51:35.666Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-b76bd55d4f3d10cf9dd950c8: start","job_status":"start","queue_duration_s":0.392647,"scheduling_latency_s":0.392682}1314gitlab # [ 144.844961] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:36.133Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"b76bd55d4f3d10cf9dd950c8","created_at":"2026-08-20T08:51:35.656Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"42084f0509838b70251cf1d61f5ade5c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T08:51:35.666Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-b76bd55d4f3d10cf9dd950c8: done: 0.074395 sec","job_status":"done","queue_duration_s":0.392647,"scheduling_latency_s":0.392682,"redis_calls":12,"redis_duration_s":0.008267,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000614,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005855,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001798,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022927,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000746743,"exclusive_lock_hold_duration_s":0.035226264,"duration_s":0.074395,"completed_at":"2026-08-20T08:51:36.133Z","load_balancing_strategy":"primary","db_duration_s":0.027755,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1315gitlab # [ 144.883675] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:36.172Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"669d628ce96a9c664664f17b","created_at":"2026-08-20T08:51:35.679Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T08:51:35.685Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-669d628ce96a9c664664f17b: start","job_status":"start","queue_duration_s":0.48663,"scheduling_latency_s":0.486671}1316gitlab # [ 145.099140] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:36.387Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"669d628ce96a9c664664f17b","created_at":"2026-08-20T08:51:35.679Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T08:51:35.685Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-669d628ce96a9c664664f17b: done: 0.215472 sec","job_status":"done","queue_duration_s":0.48663,"scheduling_latency_s":0.486671,"redis_calls":71,"redis_duration_s":0.052561000000000004,"redis_read_bytes":120,"redis_write_bytes":42624,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.016453,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001031,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.033653,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001424,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.09625,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000315682,"duration_s":0.215472,"completed_at":"2026-08-20T08:51:36.387Z","load_balancing_strategy":"primary","db_duration_s":0.013663,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1317gitlab # [ 145.134859] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:36.423Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"3c4501a6cdfb397337401276","created_at":"2026-08-20T08:51:35.704Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"50ef1f537fa194c4e920c67b45f782c5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T08:51:35.743Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-3c4501a6cdfb397337401276: start","job_status":"start","queue_duration_s":0.679602,"scheduling_latency_s":0.679672}1318gitlab # [ 145.222461] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:36.510Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"3c4501a6cdfb397337401276","created_at":"2026-08-20T08:51:35.704Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"50ef1f537fa194c4e920c67b45f782c5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T08:51:35.743Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-3c4501a6cdfb397337401276: done: 0.087791 sec","job_status":"done","queue_duration_s":0.679602,"scheduling_latency_s":0.679672,"redis_calls":14,"redis_duration_s":0.003382,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000826,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001411,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001145,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0541,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000683048,"exclusive_lock_hold_duration_s":0.047826469999999996,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.087791,"completed_at":"2026-08-20T08:51:36.510Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014224,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1319gitlab # [ 145.278519] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:36.566Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"2efa20ca7b1aea6e22588acb","created_at":"2026-08-20T08:51:35.760Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c37199f5d0ddd0856f24d2b886e26308","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T08:51:35.776Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-2efa20ca7b1aea6e22588acb: start","job_status":"start","queue_duration_s":0.789574,"scheduling_latency_s":0.789612}1320gitlab # [ 145.319928] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:36.608Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"2efa20ca7b1aea6e22588acb","created_at":"2026-08-20T08:51:35.760Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c37199f5d0ddd0856f24d2b886e26308","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T08:51:35.776Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-2efa20ca7b1aea6e22588acb: done: 0.042681 sec","job_status":"done","queue_duration_s":0.789574,"scheduling_latency_s":0.789612,"redis_calls":19,"redis_duration_s":0.004904,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001124,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.00034,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002499,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000941,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028752,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000277409,"duration_s":0.042681,"completed_at":"2026-08-20T08:51:36.608Z","load_balancing_strategy":"primary","db_duration_s":0.002782,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1321gitlab # [ 145.355503] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:36.644Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"2cda15479f0530b6e0cd6b06","created_at":"2026-08-20T08:51:35.827Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3542a3c2f30ad4fab05c8c046ca53f34","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T08:51:35.839Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-2cda15479f0530b6e0cd6b06: start","job_status":"start","queue_duration_s":0.804657,"scheduling_latency_s":0.80468}1322gitlab # [ 145.423507] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:36.712Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"2cda15479f0530b6e0cd6b06","created_at":"2026-08-20T08:51:35.827Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3542a3c2f30ad4fab05c8c046ca53f34","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T08:51:35.839Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-2cda15479f0530b6e0cd6b06: done: 0.067748 sec","job_status":"done","queue_duration_s":0.804657,"scheduling_latency_s":0.80468,"redis_calls":16,"redis_duration_s":0.005233,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002623,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001908,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000702,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032358,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000539454,"duration_s":0.067748,"completed_at":"2026-08-20T08:51:36.711Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014146,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1323gitlab # [ 145.480682] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:36.769Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"1cf53a39ac4ef175610c4f34","created_at":"2026-08-20T08:51:35.865Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"261ef8a823c1a66b0a1369c55cb0bb9b","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T08:51:35.879Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-1cf53a39ac4ef175610c4f34: start","job_status":"start","queue_duration_s":0.890189,"scheduling_latency_s":0.89022}1324gitlab # [ 145.549332] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:36.837Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"1cf53a39ac4ef175610c4f34","created_at":"2026-08-20T08:51:35.865Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"261ef8a823c1a66b0a1369c55cb0bb9b","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T08:51:35.879Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-1cf53a39ac4ef175610c4f34: done: 0.068224 sec","job_status":"done","queue_duration_s":0.890189,"scheduling_latency_s":0.89022,"redis_calls":10,"redis_duration_s":0.003459,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00058,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002191,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000688,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024018,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000586667,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.068224,"completed_at":"2026-08-20T08:51:36.837Z","load_balancing_strategy":"primary","db_duration_s":0.019422,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1325gitlab # [ 145.608749] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:36.897Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"4288e46acd5d5eae77ee50f7","created_at":"2026-08-20T08:51:35.957Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"25e6c9e9da0e158bf5f3689937fd4241","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T08:51:35.969Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-4288e46acd5d5eae77ee50f7: start","job_status":"start","queue_duration_s":0.927703,"scheduling_latency_s":0.927748}1326gitlab # [ 145.656736] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:36.945Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"4288e46acd5d5eae77ee50f7","created_at":"2026-08-20T08:51:35.957Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"25e6c9e9da0e158bf5f3689937fd4241","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T08:51:35.969Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-4288e46acd5d5eae77ee50f7: done: 0.048101 sec","job_status":"done","queue_duration_s":0.927703,"scheduling_latency_s":0.927748,"redis_calls":10,"redis_duration_s":0.002793,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000445,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00147,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000878,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021595,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000539175,"duration_s":0.048101,"completed_at":"2026-08-20T08:51:36.945Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003976,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1327gitlab # [ 145.700536] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:36.989Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"6f27d4b7f4e2f5527e49fa48","created_at":"2026-08-20T08:51:35.998Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"015289bbdfa2ae0ad3024590e6dba35f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.008Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-6f27d4b7f4e2f5527e49fa48: start","job_status":"start","queue_duration_s":0.980924,"scheduling_latency_s":0.980955}1328gitlab # [ 145.719835] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.008Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1329gitlab # [ 145.735953] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.024Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"6f27d4b7f4e2f5527e49fa48","created_at":"2026-08-20T08:51:35.998Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"015289bbdfa2ae0ad3024590e6dba35f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.008Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-6f27d4b7f4e2f5527e49fa48: done: 0.035009 sec","job_status":"done","queue_duration_s":0.980924,"scheduling_latency_s":0.980955,"redis_calls":10,"redis_duration_s":0.002685,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000428,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001688,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000569,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011319,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000469892,"duration_s":0.035009,"completed_at":"2026-08-20T08:51:37.023Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002545,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1330gitlab # [ 145.771115] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.060Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"1542771d3b81e23ae2c2ed89","created_at":"2026-08-20T08:51:36.029Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2f0cde7f9dd7518b68a3be7ee860f6d2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T08:51:36.045Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-1542771d3b81e23ae2c2ed89: start","job_status":"start","queue_duration_s":1.014536,"scheduling_latency_s":1.014559}1331gitlab # [ 145.793859] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.082Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"1542771d3b81e23ae2c2ed89","created_at":"2026-08-20T08:51:36.029Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2f0cde7f9dd7518b68a3be7ee860f6d2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T08:51:36.045Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-1542771d3b81e23ae2c2ed89: done: 0.022754 sec","job_status":"done","queue_duration_s":1.014536,"scheduling_latency_s":1.014559,"redis_calls":10,"redis_duration_s":0.001366,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000255,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000842,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000269,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013218,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000216508,"duration_s":0.022754,"completed_at":"2026-08-20T08:51:37.082Z","load_balancing_strategy":"primary","db_duration_s":0.004018,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1332gitlab # [ 145.827799] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.116Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"249822268e619cbca06eb078","created_at":"2026-08-20T08:51:36.058Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8715925ead1f914580f269cfded482af","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.091Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-249822268e619cbca06eb078: start","job_status":"start","queue_duration_s":1.025051,"scheduling_latency_s":1.025073}1333gitlab # [ 145.984335] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.272Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"249822268e619cbca06eb078","created_at":"2026-08-20T08:51:36.058Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8715925ead1f914580f269cfded482af","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.091Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-249822268e619cbca06eb078: done: 0.156242 sec","job_status":"done","queue_duration_s":1.025051,"scheduling_latency_s":1.025073,"redis_calls":12,"redis_duration_s":0.002275,"redis_read_bytes":11,"redis_write_bytes":1370,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000263,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001055,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000957,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.028,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.10019,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000379936,"exclusive_lock_hold_duration_s":0.130364613,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.156242,"completed_at":"2026-08-20T08:51:37.272Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.044974,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1334gitlab # [ 146.055289] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.344Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"de4f4238f48cf187fb44a49e","created_at":"2026-08-20T08:51:36.105Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"329c400ec3471deb2b854d426ba1a44d","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.113Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-de4f4238f48cf187fb44a49e: start","job_status":"start","queue_duration_s":1.230116,"scheduling_latency_s":1.230146}1335gitlab # [ 146.383272] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.671Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"de4f4238f48cf187fb44a49e","created_at":"2026-08-20T08:51:36.105Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"329c400ec3471deb2b854d426ba1a44d","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.113Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-de4f4238f48cf187fb44a49e: done: 0.327141 sec","job_status":"done","queue_duration_s":1.230116,"scheduling_latency_s":1.230146,"redis_calls":565,"redis_duration_s":0.102169,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000421,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001266,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.100482,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.241551,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000280483,"duration_s":0.327141,"completed_at":"2026-08-20T08:51:37.671Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000884,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1336gitlab # [ 146.385667] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.672Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"584b6239172688654dacaf6d","created_at":"2026-08-20T08:51:36.123Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6a8f2530ab4ed3b59a8f47f66707fb58","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T08:51:36.170Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-584b6239172688654dacaf6d: start","job_status":"start","queue_duration_s":1.50192,"scheduling_latency_s":1.501933}1337gitlab # [ 146.444214] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.681Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1338gitlab # [ 146.444906] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.686Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"584b6239172688654dacaf6d","created_at":"2026-08-20T08:51:36.123Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6a8f2530ab4ed3b59a8f47f66707fb58","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T08:51:36.170Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-584b6239172688654dacaf6d: done: 0.013861 sec","job_status":"done","queue_duration_s":1.50192,"scheduling_latency_s":1.501933,"redis_calls":10,"redis_duration_s":0.0017980000000000001,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000449,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001025,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000324,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007507,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000320432,"duration_s":0.013861,"completed_at":"2026-08-20T08:51:37.686Z","load_balancing_strategy":"primary","db_duration_s":0.000543,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1339gitlab # [ 146.451552] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.687Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"142226a33b8d05b9c87e0840","created_at":"2026-08-20T08:51:36.198Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6d07b92aa1a8310d67045ed80b7d0917","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.206Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-142226a33b8d05b9c87e0840: start","job_status":"start","queue_duration_s":1.480885,"scheduling_latency_s":1.480898}1340gitlab # [ 146.463896] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.695Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1341gitlab # [ 146.466757] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.700Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"142226a33b8d05b9c87e0840","created_at":"2026-08-20T08:51:36.198Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6d07b92aa1a8310d67045ed80b7d0917","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.206Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-142226a33b8d05b9c87e0840: done: 0.012826 sec","job_status":"done","queue_duration_s":1.480885,"scheduling_latency_s":1.480898,"redis_calls":10,"redis_duration_s":0.001974,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000396,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001212,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000366,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006631,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000255619,"duration_s":0.012826,"completed_at":"2026-08-20T08:51:37.700Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000588,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1342gitlab # [ 146.505232] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.701Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"7eb307a021cfb28b3076965c","created_at":"2026-08-20T08:51:36.229Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3020f9d3fe6cb8677bcd398d7268b26a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.239Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-7eb307a021cfb28b3076965c: start","job_status":"start","queue_duration_s":1.462434,"scheduling_latency_s":1.462446}1343gitlab # [ 146.512041] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.734Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"7eb307a021cfb28b3076965c","created_at":"2026-08-20T08:51:36.229Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3020f9d3fe6cb8677bcd398d7268b26a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.239Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-7eb307a021cfb28b3076965c: done: 0.032855 sec","job_status":"done","queue_duration_s":1.462434,"scheduling_latency_s":1.462446,"redis_calls":12,"redis_duration_s":0.002522,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000396,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001085,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001041,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012102,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000472965,"exclusive_lock_hold_duration_s":0.014475024,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.032855,"completed_at":"2026-08-20T08:51:37.734Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014926,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344gitlab # [ 146.548319] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.735Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"d16f10aba6a4c999824abc7a","created_at":"2026-08-20T08:51:36.257Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dfdcedde8a7a32fbccf9f3b2aa600238","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.270Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-d16f10aba6a4c999824abc7a: start","job_status":"start","queue_duration_s":1.46544,"scheduling_latency_s":1.465453}1345gitlab # [ 146.586975] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.779Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"d16f10aba6a4c999824abc7a","created_at":"2026-08-20T08:51:36.257Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dfdcedde8a7a32fbccf9f3b2aa600238","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.270Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-d16f10aba6a4c999824abc7a: done: 0.044156 sec","job_status":"done","queue_duration_s":1.46544,"scheduling_latency_s":1.465453,"redis_calls":12,"redis_duration_s":0.002021,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000801,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000931,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000289,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037166,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000243048,"duration_s":0.044156,"completed_at":"2026-08-20T08:51:37.779Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00102,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1346gitlab # [ 146.625608] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.780Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"c953f4ce85baf4f565b4ab14","created_at":"2026-08-20T08:51:36.285Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2e342f1bfecf262a476b6dd0ee2bc7e6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.302Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-c953f4ce85baf4f565b4ab14: start","job_status":"start","queue_duration_s":1.478062,"scheduling_latency_s":1.478077}1347gitlab # [ 146.626434] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.793Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"c953f4ce85baf4f565b4ab14","created_at":"2026-08-20T08:51:36.285Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2e342f1bfecf262a476b6dd0ee2bc7e6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.302Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-c953f4ce85baf4f565b4ab14: done: 0.012606 sec","job_status":"done","queue_duration_s":1.478062,"scheduling_latency_s":1.478077,"redis_calls":10,"redis_duration_s":0.00165,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000345,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000993,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000312,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006909,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000280204,"duration_s":0.012606,"completed_at":"2026-08-20T08:51:37.793Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000346,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1348gitlab # [ 146.668534] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.794Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2de47f94319ff8b440eb0793","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2de47f94319ff8b440eb0793: start","job_status":"start","queue_duration_s":1.413832,"scheduling_latency_s":1.413844}1349gitlab # [ 146.669236] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.808Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2de47f94319ff8b440eb0793","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2de47f94319ff8b440eb0793: done: 0.014206 sec","job_status":"done","queue_duration_s":1.413832,"scheduling_latency_s":1.413844,"redis_calls":16,"redis_duration_s":0.002146,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000248,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000624,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001274,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00839,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000252546,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014206,"completed_at":"2026-08-20T08:51:37.808Z","load_balancing_strategy":"primary","db_duration_s":0.000346,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1350gitlab # [ 146.706554] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.809Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dbed5f42e4a2e1a3527590fe","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dbed5f42e4a2e1a3527590fe: start","job_status":"start","queue_duration_s":1.429036,"scheduling_latency_s":1.429049}1351gitlab # [ 146.707260] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.819Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dbed5f42e4a2e1a3527590fe","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dbed5f42e4a2e1a3527590fe: done: 0.009625 sec","job_status":"done","queue_duration_s":1.429036,"scheduling_latency_s":1.429049,"redis_calls":13,"redis_duration_s":0.001523,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001005,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006396,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009625,"completed_at":"2026-08-20T08:51:37.819Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 146.718641] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.820Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b4e34042d2377df0ea0ecb7","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b4e34042d2377df0ea0ecb7: start","job_status":"start","queue_duration_s":1.439606,"scheduling_latency_s":1.439618}1353gitlab # [ 146.728545] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.829Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b4e34042d2377df0ea0ecb7","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b4e34042d2377df0ea0ecb7: done: 0.009431 sec","job_status":"done","queue_duration_s":1.439606,"scheduling_latency_s":1.439618,"redis_calls":13,"redis_duration_s":0.001598,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000604,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000994,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006064,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009431,"completed_at":"2026-08-20T08:51:37.829Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1354gitlab # [ 146.763782] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.830Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a02db366244e69bf8c5f6600","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a02db366244e69bf8c5f6600: start","job_status":"start","queue_duration_s":1.449857,"scheduling_latency_s":1.449869}1355gitlab # [ 146.799731] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.839Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a02db366244e69bf8c5f6600","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a02db366244e69bf8c5f6600: done: 0.009628 sec","job_status":"done","queue_duration_s":1.449857,"scheduling_latency_s":1.449869,"redis_calls":13,"redis_duration_s":0.001539,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000481,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001058,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006295,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009628,"completed_at":"2026-08-20T08:51:37.839Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356gitlab # [ 146.800585] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.840Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39e6659cf0a68a3574fdf43b","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39e6659cf0a68a3574fdf43b: start","job_status":"start","queue_duration_s":1.4603,"scheduling_latency_s":1.460313}1357gitlab # [ 146.808830] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.850Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39e6659cf0a68a3574fdf43b","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39e6659cf0a68a3574fdf43b: done: 0.009471 sec","job_status":"done","queue_duration_s":1.4603,"scheduling_latency_s":1.460313,"redis_calls":13,"redis_duration_s":0.001663,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000486,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001177,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006107,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009471,"completed_at":"2026-08-20T08:51:37.850Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358gitlab # [ 146.851899] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.851Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c7a87a5e6545fd990a1a479d","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c7a87a5e6545fd990a1a479d: start","job_status":"start","queue_duration_s":1.470609,"scheduling_latency_s":1.470621}1359gitlab # [ 146.852604] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.864Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c7a87a5e6545fd990a1a479d","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c7a87a5e6545fd990a1a479d: done: 0.013253 sec","job_status":"done","queue_duration_s":1.470609,"scheduling_latency_s":1.470621,"redis_calls":13,"redis_duration_s":0.001746,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00067,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001076,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007861,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013253,"completed_at":"2026-08-20T08:51:37.864Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360gitlab # [ 146.893932] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.865Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6bd12af23c61c56cb6686cd2","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6bd12af23c61c56cb6686cd2: start","job_status":"start","queue_duration_s":1.484858,"scheduling_latency_s":1.484872}1361gitlab # [ 146.894556] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.875Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6bd12af23c61c56cb6686cd2","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6bd12af23c61c56cb6686cd2: done: 0.009787 sec","job_status":"done","queue_duration_s":1.484858,"scheduling_latency_s":1.484872,"redis_calls":13,"redis_duration_s":0.001447,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000481,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000966,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006318,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009787,"completed_at":"2026-08-20T08:51:37.875Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1362gitlab # [ 146.942131] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.876Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6637c90dd985f868b538cd0e","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6637c90dd985f868b538cd0e: start","job_status":"start","queue_duration_s":1.495671,"scheduling_latency_s":1.495689}1363gitlab # [ 146.942813] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.886Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6637c90dd985f868b538cd0e","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6637c90dd985f868b538cd0e: done: 0.010672 sec","job_status":"done","queue_duration_s":1.495671,"scheduling_latency_s":1.495689,"redis_calls":13,"redis_duration_s":0.001631,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001116,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00669,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010672,"completed_at":"2026-08-20T08:51:37.886Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1364gitlab # [ 146.960759] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.887Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"97132251fceaed28209f9889","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-97132251fceaed28209f9889: start","job_status":"start","queue_duration_s":1.507309,"scheduling_latency_s":1.507323}1365gitlab # [ 146.970831] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.897Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"97132251fceaed28209f9889","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-97132251fceaed28209f9889: done: 0.009353 sec","job_status":"done","queue_duration_s":1.507309,"scheduling_latency_s":1.507323,"redis_calls":13,"redis_duration_s":0.001405,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000452,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000953,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006245,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009353,"completed_at":"2026-08-20T08:51:37.897Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1366gitlab # [ 147.014195] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.898Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9d3ff215b972b0947978325","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9d3ff215b972b0947978325: start","job_status":"start","queue_duration_s":1.518011,"scheduling_latency_s":1.518024}1367gitlab # [ 147.014763] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.907Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9d3ff215b972b0947978325","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9d3ff215b972b0947978325: done: 0.009233 sec","job_status":"done","queue_duration_s":1.518011,"scheduling_latency_s":1.518024,"redis_calls":13,"redis_duration_s":0.001423,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000481,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000942,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006362,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009233,"completed_at":"2026-08-20T08:51:37.907Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368gitlab # [ 147.068667] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.908Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48fc6a07d5317578854d0dc0","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48fc6a07d5317578854d0dc0: start","job_status":"start","queue_duration_s":1.528162,"scheduling_latency_s":1.528175}1369gitlab # [ 147.069458] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.917Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48fc6a07d5317578854d0dc0","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48fc6a07d5317578854d0dc0: done: 0.009374 sec","job_status":"done","queue_duration_s":1.528162,"scheduling_latency_s":1.528175,"redis_calls":13,"redis_duration_s":0.0016950000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000603,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001092,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006316,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009374,"completed_at":"2026-08-20T08:51:37.917Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1370gitlab # [ 147.109524] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.918Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f8c6437683ce832c6e5324c","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f8c6437683ce832c6e5324c: start","job_status":"start","queue_duration_s":1.538494,"scheduling_latency_s":1.538507}1371gitlab # [ 147.110223] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.928Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f8c6437683ce832c6e5324c","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f8c6437683ce832c6e5324c: done: 0.009494 sec","job_status":"done","queue_duration_s":1.538494,"scheduling_latency_s":1.538507,"redis_calls":13,"redis_duration_s":0.001501,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000497,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001004,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006399,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009494,"completed_at":"2026-08-20T08:51:37.928Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1372gitlab # [ 147.122501] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.929Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56faffc77fb378ef9ea917ec","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56faffc77fb378ef9ea917ec: start","job_status":"start","queue_duration_s":1.549064,"scheduling_latency_s":1.549078}1373gitlab # [ 147.157647] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.938Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56faffc77fb378ef9ea917ec","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56faffc77fb378ef9ea917ec: done: 0.009173 sec","job_status":"done","queue_duration_s":1.549064,"scheduling_latency_s":1.549078,"redis_calls":13,"redis_duration_s":0.001451,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000481,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00097,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00629,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009173,"completed_at":"2026-08-20T08:51:37.938Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1374gitlab # [ 147.163803] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.939Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc5eac9ab26836cb72e2786f","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc5eac9ab26836cb72e2786f: start","job_status":"start","queue_duration_s":1.559166,"scheduling_latency_s":1.559179}1375gitlab # [ 147.198679] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.948Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc5eac9ab26836cb72e2786f","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc5eac9ab26836cb72e2786f: done: 0.009398 sec","job_status":"done","queue_duration_s":1.559166,"scheduling_latency_s":1.559179,"redis_calls":13,"redis_duration_s":0.001439,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000494,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000945,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006323,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009398,"completed_at":"2026-08-20T08:51:37.948Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1376gitlab # [ 147.204159] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.949Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8c785e79ab7126c7025110b","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8c785e79ab7126c7025110b: start","job_status":"start","queue_duration_s":1.56923,"scheduling_latency_s":1.569243}1377gitlab # [ 147.214175] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.959Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8c785e79ab7126c7025110b","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8c785e79ab7126c7025110b: done: 0.009414 sec","job_status":"done","queue_duration_s":1.56923,"scheduling_latency_s":1.569243,"redis_calls":13,"redis_duration_s":0.001608,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000496,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001112,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00631,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009414,"completed_at":"2026-08-20T08:51:37.959Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1378gitlab # [ 147.278532] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.959Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df5c9551ae3ad4eae84d54f6","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df5c9551ae3ad4eae84d54f6: start","job_status":"start","queue_duration_s":1.579465,"scheduling_latency_s":1.579477}1379gitlab # [ 147.279200] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.969Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df5c9551ae3ad4eae84d54f6","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df5c9551ae3ad4eae84d54f6: done: 0.009708 sec","job_status":"done","queue_duration_s":1.579465,"scheduling_latency_s":1.579477,"redis_calls":13,"redis_duration_s":0.001487,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000495,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000992,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006155,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009708,"completed_at":"2026-08-20T08:51:37.969Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1380gitlab # [ 147.287221] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.970Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e497bbb55781a9eeac7957c","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e497bbb55781a9eeac7957c: start","job_status":"start","queue_duration_s":1.589981,"scheduling_latency_s":1.589994}1381gitlab # [ 147.297416] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.979Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e497bbb55781a9eeac7957c","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e497bbb55781a9eeac7957c: done: 0.009376 sec","job_status":"done","queue_duration_s":1.589981,"scheduling_latency_s":1.589994,"redis_calls":13,"redis_duration_s":0.001599,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000483,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001116,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006129,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009376,"completed_at":"2026-08-20T08:51:37.979Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1382gitlab # [ 147.335884] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.980Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b3831ac84268b98444397f24","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b3831ac84268b98444397f24: start","job_status":"start","queue_duration_s":1.600148,"scheduling_latency_s":1.600161}1383gitlab # [ 147.337551] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.989Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b3831ac84268b98444397f24","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b3831ac84268b98444397f24: done: 0.009359 sec","job_status":"done","queue_duration_s":1.600148,"scheduling_latency_s":1.600161,"redis_calls":13,"redis_duration_s":0.001381,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00046,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000921,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006208,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009359,"completed_at":"2026-08-20T08:51:37.989Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1384gitlab # [ 147.374496] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:37.990Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd75eb7c7c669bab993fec1b","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd75eb7c7c669bab993fec1b: start","job_status":"start","queue_duration_s":1.610298,"scheduling_latency_s":1.610311}1385gitlab # [ 147.378460] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.000Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd75eb7c7c669bab993fec1b","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd75eb7c7c669bab993fec1b: done: 0.009562 sec","job_status":"done","queue_duration_s":1.610298,"scheduling_latency_s":1.610311,"redis_calls":13,"redis_duration_s":0.0015279999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000478,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00105,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005946,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009562,"completed_at":"2026-08-20T08:51:38.000Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1386gitlab # [ 147.422578] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.001Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22733b33fbc6f127da3dcdf6","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22733b33fbc6f127da3dcdf6: start","job_status":"start","queue_duration_s":1.620839,"scheduling_latency_s":1.620853}1387gitlab # [ 147.423253] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.010Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22733b33fbc6f127da3dcdf6","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22733b33fbc6f127da3dcdf6: done: 0.009455 sec","job_status":"done","queue_duration_s":1.620839,"scheduling_latency_s":1.620853,"redis_calls":13,"redis_duration_s":0.00149,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000494,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000996,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00605,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009455,"completed_at":"2026-08-20T08:51:38.010Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1388gitlab # [ 147.471676] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.011Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e07e82dfec33e1cb1b3262f1","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e07e82dfec33e1cb1b3262f1: start","job_status":"start","queue_duration_s":1.631285,"scheduling_latency_s":1.631297}1389gitlab # [ 147.472493] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.021Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e07e82dfec33e1cb1b3262f1","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e07e82dfec33e1cb1b3262f1: done: 0.009444 sec","job_status":"done","queue_duration_s":1.631285,"scheduling_latency_s":1.631297,"redis_calls":13,"redis_duration_s":0.001569,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001062,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006267,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009444,"completed_at":"2026-08-20T08:51:38.021Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1390gitlab # [ 147.518984] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.022Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3dd6441e0a079bd67c051746","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3dd6441e0a079bd67c051746: start","job_status":"start","queue_duration_s":1.641683,"scheduling_latency_s":1.641697}1391gitlab # [ 147.519583] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.031Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3dd6441e0a079bd67c051746","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3dd6441e0a079bd67c051746: done: 0.00928 sec","job_status":"done","queue_duration_s":1.641683,"scheduling_latency_s":1.641697,"redis_calls":13,"redis_duration_s":0.001412,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000451,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000961,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006346,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00928,"completed_at":"2026-08-20T08:51:38.031Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 147.532627] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.032Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e7ba4f865a5b23dd4e998c5","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e7ba4f865a5b23dd4e998c5: start","job_status":"start","queue_duration_s":1.651998,"scheduling_latency_s":1.652011}1393gitlab # [ 147.542604] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.041Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e7ba4f865a5b23dd4e998c5","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e7ba4f865a5b23dd4e998c5: done: 0.009183 sec","job_status":"done","queue_duration_s":1.651998,"scheduling_latency_s":1.652011,"redis_calls":13,"redis_duration_s":0.001436,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000498,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000938,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00632,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009183,"completed_at":"2026-08-20T08:51:38.041Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 147.591862] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.042Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb92fdc574fd7dc906a4e11a","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb92fdc574fd7dc906a4e11a: start","job_status":"start","queue_duration_s":1.662113,"scheduling_latency_s":1.662126}1395gitlab # [ 147.592625] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.051Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb92fdc574fd7dc906a4e11a","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb92fdc574fd7dc906a4e11a: done: 0.009327 sec","job_status":"done","queue_duration_s":1.662113,"scheduling_latency_s":1.662126,"redis_calls":13,"redis_duration_s":0.001421,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000467,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000954,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006463,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009327,"completed_at":"2026-08-20T08:51:38.051Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396gitlab # [ 147.615029] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.052Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f84caf3ba1964de479763c0d","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f84caf3ba1964de479763c0d: start","job_status":"start","queue_duration_s":1.672301,"scheduling_latency_s":1.672314}1397gitlab # [ 147.625101] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.062Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f84caf3ba1964de479763c0d","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f84caf3ba1964de479763c0d: done: 0.009377 sec","job_status":"done","queue_duration_s":1.672301,"scheduling_latency_s":1.672314,"redis_calls":13,"redis_duration_s":0.001457,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000466,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000991,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006295,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009377,"completed_at":"2026-08-20T08:51:38.062Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398gitlab # [ 147.664228] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.062Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3eb8408ead4817e708a09589","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3eb8408ead4817e708a09589: start","job_status":"start","queue_duration_s":1.682472,"scheduling_latency_s":1.682484}1399gitlab # [ 147.665733] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.072Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3eb8408ead4817e708a09589","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3eb8408ead4817e708a09589: done: 0.009424 sec","job_status":"done","queue_duration_s":1.682472,"scheduling_latency_s":1.682484,"redis_calls":13,"redis_duration_s":0.001385,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000449,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000936,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006263,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009424,"completed_at":"2026-08-20T08:51:38.072Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400gitlab # [ 147.713181] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.073Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c012e566a4f1219fa36fc6e7","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c012e566a4f1219fa36fc6e7: start","job_status":"start","queue_duration_s":1.692666,"scheduling_latency_s":1.692678}1401gitlab # [ 147.713816] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.082Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c012e566a4f1219fa36fc6e7","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c012e566a4f1219fa36fc6e7: done: 0.009326 sec","job_status":"done","queue_duration_s":1.692666,"scheduling_latency_s":1.692678,"redis_calls":13,"redis_duration_s":0.001439,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000473,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000966,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006126,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009326,"completed_at":"2026-08-20T08:51:38.082Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402gitlab # [ 147.752943] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.083Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b42c81122a42fcca8bfa264","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b42c81122a42fcca8bfa264: start","job_status":"start","queue_duration_s":1.702736,"scheduling_latency_s":1.702749}1403gitlab # [ 147.753660] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.092Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b42c81122a42fcca8bfa264","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b42c81122a42fcca8bfa264: done: 0.009522 sec","job_status":"done","queue_duration_s":1.702736,"scheduling_latency_s":1.702749,"redis_calls":13,"redis_duration_s":0.001513,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001009,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00613,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009522,"completed_at":"2026-08-20T08:51:38.092Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 147.807202] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.093Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06a8752f449cc03c471d3a18","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06a8752f449cc03c471d3a18: start","job_status":"start","queue_duration_s":1.713137,"scheduling_latency_s":1.71315}1405gitlab # [ 147.807861] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.158Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06a8752f449cc03c471d3a18","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06a8752f449cc03c471d3a18: done: 0.064624 sec","job_status":"done","queue_duration_s":1.713137,"scheduling_latency_s":1.71315,"redis_calls":13,"redis_duration_s":0.001699,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001174,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00812,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.064624,"completed_at":"2026-08-20T08:51:38.158Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 147.818445] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.159Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93617d2d6910e7d74ee2d82c","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93617d2d6910e7d74ee2d82c: start","job_status":"start","queue_duration_s":1.778736,"scheduling_latency_s":1.778753}1407gitlab # [ 147.828447] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.170Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93617d2d6910e7d74ee2d82c","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93617d2d6910e7d74ee2d82c: done: 0.011081 sec","job_status":"done","queue_duration_s":1.778736,"scheduling_latency_s":1.778753,"redis_calls":13,"redis_duration_s":0.001431,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000461,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00097,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005963,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011081,"completed_at":"2026-08-20T08:51:38.170Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408gitlab # [ 147.879905] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.171Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d3141ebaee03749f52a5623e","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d3141ebaee03749f52a5623e: start","job_status":"start","queue_duration_s":1.790626,"scheduling_latency_s":1.79064}1409gitlab # [ 147.880641] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.180Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d3141ebaee03749f52a5623e","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d3141ebaee03749f52a5623e: done: 0.009015 sec","job_status":"done","queue_duration_s":1.790626,"scheduling_latency_s":1.79064,"redis_calls":13,"redis_duration_s":0.00172,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000448,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001272,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006067,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009015,"completed_at":"2026-08-20T08:51:38.180Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410gitlab # [ 147.927508] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.180Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9cd356e95ee147359611eda6","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9cd356e95ee147359611eda6: start","job_status":"start","queue_duration_s":1.800423,"scheduling_latency_s":1.800435}1411gitlab # [ 147.928192] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.200Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9cd356e95ee147359611eda6","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9cd356e95ee147359611eda6: done: 0.019477 sec","job_status":"done","queue_duration_s":1.800423,"scheduling_latency_s":1.800435,"redis_calls":13,"redis_duration_s":0.01158,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002125,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.009455,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006445,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019477,"completed_at":"2026-08-20T08:51:38.200Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1412gitlab # [ 147.968158] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.201Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fe670fa50c2506cae5058786","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fe670fa50c2506cae5058786: start","job_status":"start","queue_duration_s":1.820773,"scheduling_latency_s":1.820809}1413gitlab # [ 147.968856] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.210Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fe670fa50c2506cae5058786","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fe670fa50c2506cae5058786: done: 0.008898 sec","job_status":"done","queue_duration_s":1.820773,"scheduling_latency_s":1.820809,"redis_calls":13,"redis_duration_s":0.001382,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000455,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000927,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005681,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008898,"completed_at":"2026-08-20T08:51:38.210Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1414gitlab # [ 147.982600] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.211Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"67c280dfcdbc2586b5a63239","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-67c280dfcdbc2586b5a63239: start","job_status":"start","queue_duration_s":1.830814,"scheduling_latency_s":1.830827}1415gitlab # [ 148.024678] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.220Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"67c280dfcdbc2586b5a63239","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-67c280dfcdbc2586b5a63239: done: 0.008881 sec","job_status":"done","queue_duration_s":1.830814,"scheduling_latency_s":1.830827,"redis_calls":13,"redis_duration_s":0.001375,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000446,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000929,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006002,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008881,"completed_at":"2026-08-20T08:51:38.220Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1416gitlab # [ 148.025549] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.220Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ee36e767f686eeaa195f8bf","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ee36e767f686eeaa195f8bf: start","job_status":"start","queue_duration_s":1.840451,"scheduling_latency_s":1.840463}1417gitlab # [ 148.033499] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.229Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ee36e767f686eeaa195f8bf","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ee36e767f686eeaa195f8bf: done: 0.008925 sec","job_status":"done","queue_duration_s":1.840451,"scheduling_latency_s":1.840463,"redis_calls":13,"redis_duration_s":0.001398,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000445,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000953,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006084,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008925,"completed_at":"2026-08-20T08:51:38.229Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1418gitlab # [ 148.069899] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.230Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11d5de76c048ffeab5708034","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11d5de76c048ffeab5708034: start","job_status":"start","queue_duration_s":1.850154,"scheduling_latency_s":1.850166}1419gitlab # [ 148.073720] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.249Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11d5de76c048ffeab5708034","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11d5de76c048ffeab5708034: done: 0.019051 sec","job_status":"done","queue_duration_s":1.850154,"scheduling_latency_s":1.850166,"redis_calls":13,"redis_duration_s":0.009318,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002291,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007027,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006473,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019051,"completed_at":"2026-08-20T08:51:38.249Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1420gitlab # [ 148.115259] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.251Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b63fbdcf82d0df265cf460c","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b63fbdcf82d0df265cf460c: start","job_status":"start","queue_duration_s":1.871086,"scheduling_latency_s":1.871099}1421gitlab # [ 148.115875] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.268Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b63fbdcf82d0df265cf460c","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b63fbdcf82d0df265cf460c: done: 0.017169 sec","job_status":"done","queue_duration_s":1.871086,"scheduling_latency_s":1.871099,"redis_calls":13,"redis_duration_s":0.008467,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00246,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006007,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006374,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017169,"completed_at":"2026-08-20T08:51:38.268Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1422gitlab # [ 148.168249] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.269Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7bdeafc980c552eee65d0a64","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7bdeafc980c552eee65d0a64: start","job_status":"start","queue_duration_s":1.889431,"scheduling_latency_s":1.889444}1423gitlab # [ 148.168899] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.279Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7bdeafc980c552eee65d0a64","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7bdeafc980c552eee65d0a64: done: 0.0093 sec","job_status":"done","queue_duration_s":1.889431,"scheduling_latency_s":1.889444,"redis_calls":13,"redis_duration_s":0.001361,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000447,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000914,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005643,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0093,"completed_at":"2026-08-20T08:51:38.279Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1424gitlab # [ 148.186554] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.279Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c95a0eeb41000e91b22cccf3","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c95a0eeb41000e91b22cccf3: start","job_status":"start","queue_duration_s":1.899513,"scheduling_latency_s":1.899525}1425gitlab # [ 148.196625] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.288Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c95a0eeb41000e91b22cccf3","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c95a0eeb41000e91b22cccf3: done: 0.008928 sec","job_status":"done","queue_duration_s":1.899513,"scheduling_latency_s":1.899525,"redis_calls":13,"redis_duration_s":0.0014290000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000468,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000961,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006031,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008928,"completed_at":"2026-08-20T08:51:38.288Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426gitlab # [ 148.241186] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.289Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23e396c3a65a5a85f5d2a8a1","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23e396c3a65a5a85f5d2a8a1: start","job_status":"start","queue_duration_s":1.909234,"scheduling_latency_s":1.909246}1427gitlab # [ 148.241804] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.300Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23e396c3a65a5a85f5d2a8a1","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23e396c3a65a5a85f5d2a8a1: done: 0.011147 sec","job_status":"done","queue_duration_s":1.909234,"scheduling_latency_s":1.909246,"redis_calls":13,"redis_duration_s":0.0015830000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001077,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006903,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011147,"completed_at":"2026-08-20T08:51:38.300Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428gitlab # [ 148.269407] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.301Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f24279349c8e9fa231e95198","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f24279349c8e9fa231e95198: start","job_status":"start","queue_duration_s":1.921198,"scheduling_latency_s":1.92121}1429gitlab # [ 148.279445] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.310Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f24279349c8e9fa231e95198","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f24279349c8e9fa231e95198: done: 0.009252 sec","job_status":"done","queue_duration_s":1.921198,"scheduling_latency_s":1.92121,"redis_calls":13,"redis_duration_s":0.001542,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000492,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00105,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005515,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009252,"completed_at":"2026-08-20T08:51:38.310Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 148.311107] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.312Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b867f9d2e5a75a381f4f48c3","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b867f9d2e5a75a381f4f48c3: start","job_status":"start","queue_duration_s":1.931597,"scheduling_latency_s":1.93161}1431gitlab # [ 148.321162] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.321Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b867f9d2e5a75a381f4f48c3","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b867f9d2e5a75a381f4f48c3: done: 0.009094 sec","job_status":"done","queue_duration_s":1.931597,"scheduling_latency_s":1.93161,"redis_calls":13,"redis_duration_s":0.001506,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000481,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001025,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005916,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009094,"completed_at":"2026-08-20T08:51:38.321Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432gitlab # [ 148.378798] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.321Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ff0426e1d72d27afbf12cfe","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ff0426e1d72d27afbf12cfe: start","job_status":"start","queue_duration_s":1.941491,"scheduling_latency_s":1.941503}1433gitlab # [ 148.379612] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.330Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ff0426e1d72d27afbf12cfe","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ff0426e1d72d27afbf12cfe: done: 0.008959 sec","job_status":"done","queue_duration_s":1.941491,"scheduling_latency_s":1.941503,"redis_calls":13,"redis_duration_s":0.0015,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000482,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001018,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006006,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008959,"completed_at":"2026-08-20T08:51:38.330Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434gitlab # [ 148.421737] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.331Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"58d70e5d8b519ee381ea5337","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-58d70e5d8b519ee381ea5337: start","job_status":"start","queue_duration_s":1.95133,"scheduling_latency_s":1.951342}1435gitlab # [ 148.422852] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.340Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"58d70e5d8b519ee381ea5337","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-58d70e5d8b519ee381ea5337: done: 0.008871 sec","job_status":"done","queue_duration_s":1.95133,"scheduling_latency_s":1.951342,"redis_calls":13,"redis_duration_s":0.001392,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000461,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000931,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006016,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008871,"completed_at":"2026-08-20T08:51:38.340Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436gitlab # [ 148.458448] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.341Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a7c3db4bbb5955c7017dff4","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a7c3db4bbb5955c7017dff4: start","job_status":"start","queue_duration_s":1.961062,"scheduling_latency_s":1.961075}1437gitlab # [ 148.459052] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.350Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a7c3db4bbb5955c7017dff4","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a7c3db4bbb5955c7017dff4: done: 0.008673 sec","job_status":"done","queue_duration_s":1.961062,"scheduling_latency_s":1.961075,"redis_calls":13,"redis_duration_s":0.001386,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00045,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000936,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005575,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008673,"completed_at":"2026-08-20T08:51:38.350Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438gitlab # [ 148.474464] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.351Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e2ce9483c1e15144195501a3","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e2ce9483c1e15144195501a3: start","job_status":"start","queue_duration_s":1.97085,"scheduling_latency_s":1.970863}1439gitlab # [ 148.511814] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.360Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e2ce9483c1e15144195501a3","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e2ce9483c1e15144195501a3: done: 0.00902 sec","job_status":"done","queue_duration_s":1.97085,"scheduling_latency_s":1.970863,"redis_calls":13,"redis_duration_s":0.001473,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000502,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000971,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006024,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00902,"completed_at":"2026-08-20T08:51:38.360Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1440gitlab # [ 148.514737] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.361Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"19b14f79305dca2e2225547f","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-19b14f79305dca2e2225547f: start","job_status":"start","queue_duration_s":1.980711,"scheduling_latency_s":1.980724}1441gitlab # [ 148.524882] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.370Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"19b14f79305dca2e2225547f","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-19b14f79305dca2e2225547f: done: 0.009272 sec","job_status":"done","queue_duration_s":1.980711,"scheduling_latency_s":1.980724,"redis_calls":13,"redis_duration_s":0.00146,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000463,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000997,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006042,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009272,"completed_at":"2026-08-20T08:51:38.370Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 148.582734] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.371Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0175bb6a33bda30ca1b1a664","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0175bb6a33bda30ca1b1a664: start","job_status":"start","queue_duration_s":1.990741,"scheduling_latency_s":1.990753}1443gitlab # [ 148.583658] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.380Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0175bb6a33bda30ca1b1a664","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0175bb6a33bda30ca1b1a664: done: 0.00888 sec","job_status":"done","queue_duration_s":1.990741,"scheduling_latency_s":1.990753,"redis_calls":13,"redis_duration_s":0.001394,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000458,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000936,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006056,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00888,"completed_at":"2026-08-20T08:51:38.380Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444gitlab # [ 148.620494] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.380Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"304d52338ed623351c05d7b9","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-304d52338ed623351c05d7b9: start","job_status":"start","queue_duration_s":2.000472,"scheduling_latency_s":2.000483}1445gitlab # [ 148.621177] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.390Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"304d52338ed623351c05d7b9","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-304d52338ed623351c05d7b9: done: 0.009373 sec","job_status":"done","queue_duration_s":2.000472,"scheduling_latency_s":2.000483,"redis_calls":13,"redis_duration_s":0.001372,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000444,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000928,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005561,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009373,"completed_at":"2026-08-20T08:51:38.390Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446gitlab # [ 148.638519] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.391Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20ee27a10199d7b0788b13e8","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20ee27a10199d7b0788b13e8: start","job_status":"start","queue_duration_s":2.010606,"scheduling_latency_s":2.010619}1447gitlab # [ 148.675601] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.400Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20ee27a10199d7b0788b13e8","created_at":"2026-08-20T08:51:36.271Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-a91fcbf5143347a2","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a2ec4998b72c99964d7c39c3c0a49641","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.380Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20ee27a10199d7b0788b13e8: done: 0.00901 sec","job_status":"done","queue_duration_s":2.010606,"scheduling_latency_s":2.010619,"redis_calls":13,"redis_duration_s":0.00149,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000491,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000999,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006058,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00901,"completed_at":"2026-08-20T08:51:38.400Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 148.710189] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.400Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"2339a53abe574efd00af9570","created_at":"2026-08-20T08:51:36.588Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-d10ca0d116a4452d","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c37199f5d0ddd0856f24d2b886e26308","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.602Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-2339a53abe574efd00af9570: start","job_status":"start","queue_duration_s":1.7979,"scheduling_latency_s":1.797912}1449gitlab # [ 148.710789] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.411Z","message":"No existing merge request to be cleaned up."}1450gitlab # [ 148.711404] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.418Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"2339a53abe574efd00af9570","created_at":"2026-08-20T08:51:36.588Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-d10ca0d116a4452d","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c37199f5d0ddd0856f24d2b886e26308","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.602Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-2339a53abe574efd00af9570: done: 0.018117 sec","job_status":"done","queue_duration_s":1.7979,"scheduling_latency_s":1.797912,"redis_calls":13,"redis_duration_s":0.001704,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000277,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000632,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000795,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011594,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000209523,"duration_s":0.018117,"completed_at":"2026-08-20T08:51:38.418Z","load_balancing_strategy":"primary","db_duration_s":0.002608,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451gitlab # [ 148.747485] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.419Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"2f89011268be70be940020ae","created_at":"2026-08-20T08:51:36.588Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-d10ca0d116a4452d","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c37199f5d0ddd0856f24d2b886e26308","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.602Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-2f89011268be70be940020ae: start","job_status":"start","queue_duration_s":1.816847,"scheduling_latency_s":1.816859}1452gitlab # [ 148.748226] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.426Z","message":"No existing merge request to be cleaned up."}1453gitlab # [ 148.748841] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.430Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"2f89011268be70be940020ae","created_at":"2026-08-20T08:51:36.588Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-d10ca0d116a4452d","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c37199f5d0ddd0856f24d2b886e26308","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.602Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-2f89011268be70be940020ae: done: 0.010743 sec","job_status":"done","queue_duration_s":1.816847,"scheduling_latency_s":1.816859,"redis_calls":10,"redis_duration_s":0.001279,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000762,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007073,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010743,"completed_at":"2026-08-20T08:51:38.430Z","load_balancing_strategy":"primary","db_duration_s":0.000981,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454gitlab # [ 148.784969] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.431Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"121a8623e174eb994fea39fa","created_at":"2026-08-20T08:51:36.588Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-d10ca0d116a4452d","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c37199f5d0ddd0856f24d2b886e26308","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.602Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-121a8623e174eb994fea39fa: start","job_status":"start","queue_duration_s":1.828387,"scheduling_latency_s":1.8284}1455gitlab # [ 148.785332] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.437Z","message":"No existing merge request to be cleaned up."}1456gitlab # [ 148.785774] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.441Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"121a8623e174eb994fea39fa","created_at":"2026-08-20T08:51:36.588Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-d10ca0d116a4452d","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c37199f5d0ddd0856f24d2b886e26308","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.602Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-121a8623e174eb994fea39fa: done: 0.010374 sec","job_status":"done","queue_duration_s":1.828387,"scheduling_latency_s":1.8284,"redis_calls":10,"redis_duration_s":0.001155,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000471,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000684,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007095,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010374,"completed_at":"2026-08-20T08:51:38.441Z","load_balancing_strategy":"primary","db_duration_s":0.000958,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1457gitlab # [ 148.805366] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.442Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a5e67bb93958f8dcf7dad77a","created_at":"2026-08-20T08:51:36.588Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-d10ca0d116a4452d","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c37199f5d0ddd0856f24d2b886e26308","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.602Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a5e67bb93958f8dcf7dad77a: start","job_status":"start","queue_duration_s":1.839547,"scheduling_latency_s":1.83956}1458gitlab # [ 148.815593] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.451Z","message":"No existing merge request to be cleaned up."}1459gitlab # [ 148.816802] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:51:38.456Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a5e67bb93958f8dcf7dad77a","created_at":"2026-08-20T08:51:36.588Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-d10ca0d116a4452d","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c37199f5d0ddd0856f24d2b886e26308","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:51:36.602Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a5e67bb93958f8dcf7dad77a: done: 0.013787 sec","job_status":"done","queue_duration_s":1.839547,"scheduling_latency_s":1.83956,"redis_calls":10,"redis_duration_s":0.0043040000000000005,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001022,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003282,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007449,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013787,"completed_at":"2026-08-20T08:51:38.456Z","load_balancing_strategy":"primary","db_duration_s":0.001052,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460gitlab # [ 149.018908] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 2599322309 wd_nsec: 25993224351461gitlab # [ 161.173816] setup-gitlab-start[2219]: W, [2026-08-20T08:51:52.462140 #2219] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1462gitlab # [ 174.350513] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:05.638Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"137e85dcb2aea04f590080ae","created_at":"2026-08-20T08:52:05.591Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a9a963231a570acddc8080c9f10650f2","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:05.635Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-137e85dcb2aea04f590080ae: start","job_status":"start","queue_duration_s":0.002825,"scheduling_latency_s":0.002931}1463gitlab # [ 174.426453] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:05.714Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"137e85dcb2aea04f590080ae","created_at":"2026-08-20T08:52:05.591Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a9a963231a570acddc8080c9f10650f2","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:05.635Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-137e85dcb2aea04f590080ae: done: 0.076662 sec","job_status":"done","queue_duration_s":0.002825,"scheduling_latency_s":0.002931,"redis_calls":9,"redis_duration_s":0.00492,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003081,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001839,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.04,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.04,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019663,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001956394,"exclusive_lock_hold_duration_s":0.043013847,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.076662,"completed_at":"2026-08-20T08:52:05.714Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.056232,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1464gitlab # [ 174.484453] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:05.772Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"3ce4352c853753a4ef36b326","created_at":"2026-08-20T08:52:05.667Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ff8b8e64684c5832970dfbc13433f6f9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T08:52:05.670Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-3ce4352c853753a4ef36b326: start","job_status":"start","queue_duration_s":0.102682,"scheduling_latency_s":0.102725}1465gitlab # [ 174.518825] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:05.807Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1466gitlab # [ 174.544633] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:05.833Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"3ce4352c853753a4ef36b326","created_at":"2026-08-20T08:52:05.667Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ff8b8e64684c5832970dfbc13433f6f9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T08:52:05.670Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-3ce4352c853753a4ef36b326: done: 0.060217 sec","job_status":"done","queue_duration_s":0.102682,"scheduling_latency_s":0.102725,"redis_calls":7,"redis_duration_s":0.010824,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004348,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.006476,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010714,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.060217,"completed_at":"2026-08-20T08:52:05.833Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1467gitlab # [ 174.579116] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:05.867Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"bbe8174fa33ee70083e93c2f","created_at":"2026-08-20T08:52:05.676Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3f6fb93dac6b602ee3e4934ecf77775f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:05.680Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-bbe8174fa33ee70083e93c2f: start","job_status":"start","queue_duration_s":0.187698,"scheduling_latency_s":0.187732}1468gitlab # [ 174.589073] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:05.878Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1469gitlab # [ 174.600263] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:05.888Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"bbe8174fa33ee70083e93c2f","created_at":"2026-08-20T08:52:05.676Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3f6fb93dac6b602ee3e4934ecf77775f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:05.680Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-bbe8174fa33ee70083e93c2f: done: 0.021261 sec","job_status":"done","queue_duration_s":0.187698,"scheduling_latency_s":0.187732,"redis_calls":7,"redis_duration_s":0.004305,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00071,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003595,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006394,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021261,"completed_at":"2026-08-20T08:52:05.888Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470gitlab # [ 174.632365] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:05.889Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"582143daa15c29e6c9d11f89","created_at":"2026-08-20T08:52:05.690Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"895990e4dda7080e41ea9d9e96f4153a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:05.692Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-582143daa15c29e6c9d11f89: start","job_status":"start","queue_duration_s":0.197199,"scheduling_latency_s":0.197213}1471gitlab # [ 174.633225] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:05.896Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1472gitlab # [ 174.633865] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:05.899Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"582143daa15c29e6c9d11f89","created_at":"2026-08-20T08:52:05.690Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"895990e4dda7080e41ea9d9e96f4153a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:05.692Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-582143daa15c29e6c9d11f89: done: 0.009393 sec","job_status":"done","queue_duration_s":0.197199,"scheduling_latency_s":0.197213,"redis_calls":7,"redis_duration_s":0.000859,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00061,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000249,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004512,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009393,"completed_at":"2026-08-20T08:52:05.899Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1473gitlab # [ 174.676618] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:05.900Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"ca54f406b15c798ec3e4bec5","created_at":"2026-08-20T08:52:05.699Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0eb4ef1d7c577a9a9246920542ab0499","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:05.709Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-ca54f406b15c798ec3e4bec5: start","job_status":"start","queue_duration_s":0.190454,"scheduling_latency_s":0.190467}1474gitlab # [ 174.677208] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:05.912Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"ca54f406b15c798ec3e4bec5","created_at":"2026-08-20T08:52:05.699Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0eb4ef1d7c577a9a9246920542ab0499","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:05.709Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-ca54f406b15c798ec3e4bec5: done: 0.012713 sec","job_status":"done","queue_duration_s":0.190454,"scheduling_latency_s":0.190467,"redis_calls":10,"redis_duration_s":0.001314,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000771,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000543,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007795,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.003663036,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.012713,"completed_at":"2026-08-20T08:52:05.912Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001866,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1475gitlab # [ 174.711656] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:05.913Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"1387967723dd31be68f4e520","created_at":"2026-08-20T08:52:05.770Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2641559286c11c51acd9f1ce995cb8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:05.786Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-1387967723dd31be68f4e520: start","job_status":"start","queue_duration_s":0.127562,"scheduling_latency_s":0.127575}1476gitlab # [ 174.712462] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:05.923Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"1387967723dd31be68f4e520","created_at":"2026-08-20T08:52:05.770Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2641559286c11c51acd9f1ce995cb8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:05.786Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-1387967723dd31be68f4e520: done: 0.009991 sec","job_status":"done","queue_duration_s":0.127562,"scheduling_latency_s":0.127575,"redis_calls":9,"redis_duration_s":0.0012239999999999998,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000668,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000556,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000327137,"exclusive_lock_hold_duration_s":0.002118705,"duration_s":0.009991,"completed_at":"2026-08-20T08:52:05.923Z","load_balancing_strategy":"primary","db_duration_s":0.000827,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1477gitlab # [ 174.748985] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:05.924Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"e73a63215b2cd46a975aa85d","created_at":"2026-08-20T08:52:05.802Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:05.806Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-e73a63215b2cd46a975aa85d: start","job_status":"start","queue_duration_s":0.118319,"scheduling_latency_s":0.118331}1478gitlab # [ 174.789634] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:06.078Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"e73a63215b2cd46a975aa85d","created_at":"2026-08-20T08:52:05.802Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:05.806Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-e73a63215b2cd46a975aa85d: done: 0.154015 sec","job_status":"done","queue_duration_s":0.118319,"scheduling_latency_s":0.118331,"redis_calls":60,"redis_duration_s":0.055587000000000004,"redis_read_bytes":108,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.000638,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.054586,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000363,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050927,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.154015,"completed_at":"2026-08-20T08:52:06.078Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1479gitlab # [ 174.790696] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:06.079Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"0be342f0d2c6ff0848cedcdf","created_at":"2026-08-20T08:52:05.826Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"176b896e73e8a5ee312d7d0a1ca25b7e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:05.830Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-0be342f0d2c6ff0848cedcdf: start","job_status":"start","queue_duration_s":0.248888,"scheduling_latency_s":0.248907}1480gitlab # [ 174.822708] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:06.111Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"0be342f0d2c6ff0848cedcdf","created_at":"2026-08-20T08:52:05.826Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"176b896e73e8a5ee312d7d0a1ca25b7e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:05.830Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-0be342f0d2c6ff0848cedcdf: done: 0.032066 sec","job_status":"done","queue_duration_s":0.248888,"scheduling_latency_s":0.248907,"redis_calls":9,"redis_duration_s":0.00124,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000623,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000617,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013345,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000310095,"exclusive_lock_hold_duration_s":0.022829438,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.032066,"completed_at":"2026-08-20T08:52:06.111Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018893,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1481gitlab # [ 174.832754] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:06.112Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"cf61dfcd5ce2b300440268d1","created_at":"2026-08-20T08:52:05.875Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"17bbca113882bec3b8bbe44f6319eaa3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:05.881Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-cf61dfcd5ce2b300440268d1: start","job_status":"start","queue_duration_s":0.231261,"scheduling_latency_s":0.231274}1482gitlab # [ 174.868934] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:06.127Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"cf61dfcd5ce2b300440268d1","created_at":"2026-08-20T08:52:05.875Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"17bbca113882bec3b8bbe44f6319eaa3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:05.881Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-cf61dfcd5ce2b300440268d1: done: 0.015091 sec","job_status":"done","queue_duration_s":0.231261,"scheduling_latency_s":0.231274,"redis_calls":14,"redis_duration_s":0.001691,"redis_read_bytes":16,"redis_write_bytes":4030,"redis_queues_calls":2,"redis_queues_duration_s":0.000163,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001157,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000371,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010593,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015091,"completed_at":"2026-08-20T08:52:06.127Z","load_balancing_strategy":"primary","db_duration_s":0.001052,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1483gitlab # [ 174.875652] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:06.128Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"2f32ce0bc1ec74c6726e7b77","created_at":"2026-08-20T08:52:05.883Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c128d28569b5945ac1ebaafe35d53205","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:05.884Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-2f32ce0bc1ec74c6726e7b77: start","job_status":"start","queue_duration_s":0.243957,"scheduling_latency_s":0.24397}1484gitlab # [ 174.909582] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:06.142Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"2f32ce0bc1ec74c6726e7b77","created_at":"2026-08-20T08:52:05.883Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c128d28569b5945ac1ebaafe35d53205","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:05.884Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-2f32ce0bc1ec74c6726e7b77: done: 0.013832 sec","job_status":"done","queue_duration_s":0.243957,"scheduling_latency_s":0.24397,"redis_calls":7,"redis_duration_s":0.0008879999999999999,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000649,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000239,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006555,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013832,"completed_at":"2026-08-20T08:52:06.142Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004711,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1485gitlab # [ 174.945653] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:06.143Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"758c1da3f4484920cc7e7915","created_at":"2026-08-20T08:52:05.886Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f23fc47ce2711ea0160a18093f42c089","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:05.934Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-758c1da3f4484920cc7e7915: start","job_status":"start","queue_duration_s":0.209011,"scheduling_latency_s":0.209024}1486gitlab # [ 174.946516] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:06.158Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"758c1da3f4484920cc7e7915","created_at":"2026-08-20T08:52:05.886Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f23fc47ce2711ea0160a18093f42c089","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:05.934Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-758c1da3f4484920cc7e7915: done: 0.015531 sec","job_status":"done","queue_duration_s":0.209011,"scheduling_latency_s":0.209024,"redis_calls":10,"redis_duration_s":0.001215,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000265,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000717,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000233,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00926,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000218184,"duration_s":0.015531,"completed_at":"2026-08-20T08:52:06.158Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00248,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1487gitlab # [ 174.962892] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:06.159Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"e4a9253592cdb7121f32ac20","created_at":"2026-08-20T08:52:05.941Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7bfdde258ba53d6f48d0effba91ac32a","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:05.945Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-e4a9253592cdb7121f32ac20: start","job_status":"start","queue_duration_s":0.213889,"scheduling_latency_s":0.213901}1488gitlab # [ 174.974171] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:06.172Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"e4a9253592cdb7121f32ac20","created_at":"2026-08-20T08:52:05.941Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7bfdde258ba53d6f48d0effba91ac32a","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:05.945Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-e4a9253592cdb7121f32ac20: done: 0.013278 sec","job_status":"done","queue_duration_s":0.213889,"scheduling_latency_s":0.213901,"redis_calls":7,"redis_duration_s":0.00121,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000935,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000275,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005405,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.013278,"completed_at":"2026-08-20T08:52:06.172Z","load_balancing_strategy":"primary","db_duration_s":0.004769,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1489gitlab # [ 175.021042] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:06.173Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"a7b10a4271207cbc5b208169","created_at":"2026-08-20T08:52:05.953Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"101bc5716d448e548dba7398a3adef91","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:05.955Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-a7b10a4271207cbc5b208169: start","job_status":"start","queue_duration_s":0.218022,"scheduling_latency_s":0.218035}1490gitlab # [ 175.021624] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:06.182Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"a7b10a4271207cbc5b208169","created_at":"2026-08-20T08:52:05.953Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"101bc5716d448e548dba7398a3adef91","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:05.955Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-a7b10a4271207cbc5b208169: done: 0.008399 sec","job_status":"done","queue_duration_s":0.218022,"scheduling_latency_s":0.218035,"redis_calls":7,"redis_duration_s":0.00087,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000628,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000242,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005146,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008399,"completed_at":"2026-08-20T08:52:06.182Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000536,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1491gitlab # [ 175.067808] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:06.182Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"ac65809310a3e6dc856d09fa","created_at":"2026-08-20T08:52:05.961Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"229fc9ac6cfad74d0129c5e61eed7526","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:05.963Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-ac65809310a3e6dc856d09fa: start","job_status":"start","queue_duration_s":0.219015,"scheduling_latency_s":0.219027}1492gitlab # [ 175.068483] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:06.187Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1493gitlab # [ 175.068941] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:06.190Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"ac65809310a3e6dc856d09fa","created_at":"2026-08-20T08:52:05.961Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"229fc9ac6cfad74d0129c5e61eed7526","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:05.963Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-ac65809310a3e6dc856d09fa: done: 0.007429 sec","job_status":"done","queue_duration_s":0.219015,"scheduling_latency_s":0.219027,"redis_calls":7,"redis_duration_s":0.001067,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00084,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000227,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004509,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.007429,"completed_at":"2026-08-20T08:52:06.190Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1494gitlab # [ 175.110942] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:06.191Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"0a19035ef8e19d0b648de84e","created_at":"2026-08-20T08:52:05.968Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2edb4dbfe794e4a69aa0db4827b517d9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T08:52:05.970Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-0a19035ef8e19d0b648de84e: start","job_status":"start","queue_duration_s":0.22049,"scheduling_latency_s":0.220502}1495gitlab # [ 175.111597] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:06.205Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"0a19035ef8e19d0b648de84e","created_at":"2026-08-20T08:52:05.968Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2edb4dbfe794e4a69aa0db4827b517d9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T08:52:05.970Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-0a19035ef8e19d0b648de84e: done: 0.014169 sec","job_status":"done","queue_duration_s":0.22049,"scheduling_latency_s":0.220502,"redis_calls":7,"redis_duration_s":0.0008680000000000001,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000631,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000237,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008202,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014169,"completed_at":"2026-08-20T08:52:06.205Z","load_balancing_strategy":"primary","db_duration_s":0.003243,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1496gitlab # [ 175.152915] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:06.206Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"a0c2fc254b24d63b45d380a1","created_at":"2026-08-20T08:52:05.973Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cb589448afa7965517cc0ca8ed06e7b2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:05.975Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-a0c2fc254b24d63b45d380a1: start","job_status":"start","queue_duration_s":0.230765,"scheduling_latency_s":0.230778}1497gitlab # [ 175.153696] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:06.347Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"a0c2fc254b24d63b45d380a1","created_at":"2026-08-20T08:52:05.973Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cb589448afa7965517cc0ca8ed06e7b2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:05.975Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-a0c2fc254b24d63b45d380a1: done: 0.141555 sec","job_status":"done","queue_duration_s":0.230765,"scheduling_latency_s":0.230778,"redis_calls":11,"redis_duration_s":0.0015040000000000001,"redis_read_bytes":9,"redis_write_bytes":1262,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000236,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":275,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000626,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000642,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":130,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.092304,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000286349,"exclusive_lock_hold_duration_s":0.130403445,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.141555,"completed_at":"2026-08-20T08:52:06.347Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.054794,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1498gitlab # [ 175.209623] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:06.348Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"53374622061343c3fb3c97b9","created_at":"2026-08-20T08:52:05.980Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"37be33eb64f172bff2b9b8445a06f3b6","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:05.983Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-53374622061343c3fb3c97b9: start","job_status":"start","queue_duration_s":0.365626,"scheduling_latency_s":0.36564}1499gitlab # [ 175.295299] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:06.584Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"53374622061343c3fb3c97b9","created_at":"2026-08-20T08:52:05.980Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"37be33eb64f172bff2b9b8445a06f3b6","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:05.983Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-53374622061343c3fb3c97b9: done: 0.235269 sec","job_status":"done","queue_duration_s":0.365626,"scheduling_latency_s":0.36564,"redis_calls":562,"redis_duration_s":0.062403,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000798,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.061605,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.195066,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.235269,"completed_at":"2026-08-20T08:52:06.584Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1500gitlab # [ 175.329713] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:06.618Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"4f41a8b5ebb4a2b5445ef7f5","created_at":"2026-08-20T08:52:05.985Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fa8361b32d7474b5dc30db897ff06c8b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T08:52:05.987Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-4f41a8b5ebb4a2b5445ef7f5: start","job_status":"start","queue_duration_s":0.630708,"scheduling_latency_s":0.630754}1501gitlab # [ 175.345688] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:06.634Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1502gitlab # [ 175.352993] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:06.641Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"4f41a8b5ebb4a2b5445ef7f5","created_at":"2026-08-20T08:52:05.985Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fa8361b32d7474b5dc30db897ff06c8b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T08:52:05.987Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-4f41a8b5ebb4a2b5445ef7f5: done: 0.023122 sec","job_status":"done","queue_duration_s":0.630708,"scheduling_latency_s":0.630754,"redis_calls":7,"redis_duration_s":0.003875,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003578,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000297,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005802,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023122,"completed_at":"2026-08-20T08:52:06.641Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1503gitlab # [ 175.354630] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:06.642Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"8776f0a68b86e56b3fce1535","created_at":"2026-08-20T08:52:05.990Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e20d4d46d53b0a1259cc7304a75b021c","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:05.997Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-8776f0a68b86e56b3fce1535: start","job_status":"start","queue_duration_s":0.645149,"scheduling_latency_s":0.645162}1504gitlab # [ 175.425302] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:06.713Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"8776f0a68b86e56b3fce1535","created_at":"2026-08-20T08:52:05.990Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e20d4d46d53b0a1259cc7304a75b021c","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:05.997Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-8776f0a68b86e56b3fce1535: done: 0.071505 sec","job_status":"done","queue_duration_s":0.645149,"scheduling_latency_s":0.645162,"redis_calls":12,"redis_duration_s":0.003123,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000474,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001771,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000878,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018061,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00071685,"exclusive_lock_hold_duration_s":0.005967238000000001,"duration_s":0.071505,"completed_at":"2026-08-20T08:52:06.713Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003709,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1505gitlab # [ 175.460808] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:06.749Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"bd092b35fe62f2379eab9597","created_at":"2026-08-20T08:52:06.002Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f6c37aabaf5d54edbef3d1509764f23e","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.010Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-bd092b35fe62f2379eab9597: start","job_status":"start","queue_duration_s":0.738956,"scheduling_latency_s":0.738989}1506gitlab # [ 175.487163] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:06.775Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"bd092b35fe62f2379eab9597","created_at":"2026-08-20T08:52:06.002Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f6c37aabaf5d54edbef3d1509764f23e","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.010Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-bd092b35fe62f2379eab9597: done: 0.026237 sec","job_status":"done","queue_duration_s":0.738956,"scheduling_latency_s":0.738989,"redis_calls":12,"redis_duration_s":0.003406,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.00064,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00056,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001586,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00062,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000421562,"duration_s":0.026237,"completed_at":"2026-08-20T08:52:06.775Z","load_balancing_strategy":"primary","db_duration_s":0.000788,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1507gitlab # [ 175.522606] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:06.811Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"395dd4ca826924ddf4a90607","created_at":"2026-08-20T08:52:06.013Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"62d6d48690edc14d5711cb9b41a9bea9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.014Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-395dd4ca826924ddf4a90607: start","job_status":"start","queue_duration_s":0.796472,"scheduling_latency_s":0.796505}1508gitlab # [ 175.543873] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:06.832Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1509gitlab # [ 175.553705] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:06.842Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"395dd4ca826924ddf4a90607","created_at":"2026-08-20T08:52:06.013Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"62d6d48690edc14d5711cb9b41a9bea9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.014Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-395dd4ca826924ddf4a90607: done: 0.03098 sec","job_status":"done","queue_duration_s":0.796472,"scheduling_latency_s":0.796505,"redis_calls":7,"redis_duration_s":0.0034270000000000004,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002841,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000586,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012064,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03098,"completed_at":"2026-08-20T08:52:06.842Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1510gitlab # [ 175.588879] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:06.876Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"2ffc090f010f3e70a009727c","created_at":"2026-08-20T08:52:06.023Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f43458244a68bbc0902c8e27fcd65044","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.026Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-2ffc090f010f3e70a009727c: start","job_status":"start","queue_duration_s":0.850364,"scheduling_latency_s":0.850403}1511gitlab # [ 175.643298] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:06.931Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"2ffc090f010f3e70a009727c","created_at":"2026-08-20T08:52:06.023Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f43458244a68bbc0902c8e27fcd65044","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.026Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-2ffc090f010f3e70a009727c: done: 0.05512 sec","job_status":"done","queue_duration_s":0.850364,"scheduling_latency_s":0.850403,"redis_calls":9,"redis_duration_s":0.0021060000000000002,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001134,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000972,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024424,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000793676,"exclusive_lock_hold_duration_s":0.015145779,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.05512,"completed_at":"2026-08-20T08:52:06.931Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013361,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1512gitlab # [ 175.680180] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:06.968Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"6d48f0e44d54d6bfc9f72d58","created_at":"2026-08-20T08:52:06.030Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fd20cd8aff1fe3dd3e13aef14117e84a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.032Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-6d48f0e44d54d6bfc9f72d58: start","job_status":"start","queue_duration_s":0.936367,"scheduling_latency_s":0.936407}1513gitlab # [ 175.701149] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:06.989Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"6d48f0e44d54d6bfc9f72d58","created_at":"2026-08-20T08:52:06.030Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fd20cd8aff1fe3dd3e13aef14117e84a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.032Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-6d48f0e44d54d6bfc9f72d58: done: 0.021057 sec","job_status":"done","queue_duration_s":0.936367,"scheduling_latency_s":0.936407,"redis_calls":7,"redis_duration_s":0.002333,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001619,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000714,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012789,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021057,"completed_at":"2026-08-20T08:52:06.989Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1514gitlab # [ 175.737186] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:07.025Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"0c73262355b6510d5ee53ccb","created_at":"2026-08-20T08:52:06.035Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5546d217780ce1d67b7ef90d273dc579","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.037Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-0c73262355b6510d5ee53ccb: start","job_status":"start","queue_duration_s":0.987705,"scheduling_latency_s":0.987745}1515gitlab # [ 175.767348] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:07.055Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"0c73262355b6510d5ee53ccb","created_at":"2026-08-20T08:52:06.035Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5546d217780ce1d67b7ef90d273dc579","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.037Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-0c73262355b6510d5ee53ccb: done: 0.030125 sec","job_status":"done","queue_duration_s":0.987705,"scheduling_latency_s":0.987745,"redis_calls":7,"redis_duration_s":0.001691,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001201,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00049,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01281,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030125,"completed_at":"2026-08-20T08:52:07.055Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1516gitlab # [ 175.802891] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:07.090Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"c42da29cd783f54d4bb67d79","created_at":"2026-08-20T08:52:06.043Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"fcd94bc68979c48102a0ad036f6fe7d3","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.050Z","job_size_bytes":3,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-c42da29cd783f54d4bb67d79: start","job_status":"start","queue_duration_s":1.039708,"scheduling_latency_s":1.039757}1517gitlab # [ 175.833725] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:07.122Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"c42da29cd783f54d4bb67d79","created_at":"2026-08-20T08:52:06.043Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-f9be2561d7294a04","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"fcd94bc68979c48102a0ad036f6fe7d3","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.050Z","job_size_bytes":3,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-c42da29cd783f54d4bb67d79: done: 0.031788 sec","job_status":"done","queue_duration_s":1.039708,"scheduling_latency_s":1.039757,"redis_calls":10,"redis_duration_s":0.002717,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000594,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001634,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000489,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015145,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000440279,"duration_s":0.031788,"completed_at":"2026-08-20T08:52:07.122Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00083,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1518gitlab # [ 175.866924] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:07.124Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"26a12a61e92b6ca5ad2a9bdc","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-26a12a61e92b6ca5ad2a9bdc: start","job_status":"start","queue_duration_s":1.051641,"scheduling_latency_s":1.051672}1519gitlab # [ 175.876969] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:07.144Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"26a12a61e92b6ca5ad2a9bdc","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-26a12a61e92b6ca5ad2a9bdc: done: 0.020068 sec","job_status":"done","queue_duration_s":1.051641,"scheduling_latency_s":1.051672,"redis_calls":13,"redis_duration_s":0.00347,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001217,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002253,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012478,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020068,"completed_at":"2026-08-20T08:52:07.144Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1520gitlab # [ 175.907906] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:07.145Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"03d4abdc1bf780943e26e755","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-03d4abdc1bf780943e26e755: start","job_status":"start","queue_duration_s":1.072622,"scheduling_latency_s":1.072636}1521gitlab # [ 175.917985] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:07.155Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"03d4abdc1bf780943e26e755","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-03d4abdc1bf780943e26e755: done: 0.009828 sec","job_status":"done","queue_duration_s":1.072622,"scheduling_latency_s":1.072636,"redis_calls":13,"redis_duration_s":0.001503,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00048,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001023,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005655,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009828,"completed_at":"2026-08-20T08:52:07.155Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1522gitlab # [ 175.937234] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:07.156Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55ed36a177eb65f1a647f66a","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55ed36a177eb65f1a647f66a: start","job_status":"start","queue_duration_s":1.083267,"scheduling_latency_s":1.08328}1523gitlab # [ 175.938255] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:07.165Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55ed36a177eb65f1a647f66a","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55ed36a177eb65f1a647f66a: done: 0.009204 sec","job_status":"done","queue_duration_s":1.083267,"scheduling_latency_s":1.08328,"redis_calls":13,"redis_duration_s":0.001505,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00099,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005999,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009204,"completed_at":"2026-08-20T08:52:07.165Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1524gitlab # [ 175.983321] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:07.166Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2865f81a73cdfaad27bde708","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2865f81a73cdfaad27bde708: start","job_status":"start","queue_duration_s":1.093325,"scheduling_latency_s":1.093338}1525gitlab # [ 175.984101] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:07.177Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2865f81a73cdfaad27bde708","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2865f81a73cdfaad27bde708: done: 0.010969 sec","job_status":"done","queue_duration_s":1.093325,"scheduling_latency_s":1.093338,"redis_calls":13,"redis_duration_s":0.001521,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001021,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007711,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010969,"completed_at":"2026-08-20T08:52:07.177Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1526gitlab # [ 175.997810] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:07.178Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47f128c843f4522c4c040a73","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47f128c843f4522c4c040a73: start","job_status":"start","queue_duration_s":1.10509,"scheduling_latency_s":1.105125}1527gitlab # [ 176.008386] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:07.187Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47f128c843f4522c4c040a73","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47f128c843f4522c4c040a73: done: 0.008786 sec","job_status":"done","queue_duration_s":1.10509,"scheduling_latency_s":1.105125,"redis_calls":13,"redis_duration_s":0.0014949999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000481,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001014,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005578,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008786,"completed_at":"2026-08-20T08:52:07.186Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1528gitlab # [ 176.046499] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:07.188Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9047bd17d4f8b9b7a808cd47","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9047bd17d4f8b9b7a808cd47: start","job_status":"start","queue_duration_s":1.115092,"scheduling_latency_s":1.115127}1529gitlab # [ 176.049223] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:07.197Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9047bd17d4f8b9b7a808cd47","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9047bd17d4f8b9b7a808cd47: done: 0.009105 sec","job_status":"done","queue_duration_s":1.115092,"scheduling_latency_s":1.115127,"redis_calls":13,"redis_duration_s":0.001479,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000479,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00588,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009105,"completed_at":"2026-08-20T08:52:07.197Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1530gitlab # [ 176.097355] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:07.198Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6cc1ada3bc28e0dd3c9d6fb","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6cc1ada3bc28e0dd3c9d6fb: start","job_status":"start","queue_duration_s":1.124984,"scheduling_latency_s":1.124997}1531gitlab # [ 176.098374] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:07.207Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6cc1ada3bc28e0dd3c9d6fb","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6cc1ada3bc28e0dd3c9d6fb: done: 0.009222 sec","job_status":"done","queue_duration_s":1.124984,"scheduling_latency_s":1.124997,"redis_calls":13,"redis_duration_s":0.0014910000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000985,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005985,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009222,"completed_at":"2026-08-20T08:52:07.207Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1532gitlab # [ 176.152743] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:07.208Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3bca7898bc37777028f32c2","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3bca7898bc37777028f32c2: start","job_status":"start","queue_duration_s":1.135008,"scheduling_latency_s":1.13502}1533gitlab # [ 176.153723] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:07.217Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3bca7898bc37777028f32c2","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3bca7898bc37777028f32c2: done: 0.009525 sec","job_status":"done","queue_duration_s":1.135008,"scheduling_latency_s":1.13502,"redis_calls":13,"redis_duration_s":0.001604,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000495,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001109,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006187,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009525,"completed_at":"2026-08-20T08:52:07.217Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1534gitlab # [ 176.163994] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:07.218Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9fe63bda4ae2970a81e88f40","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9fe63bda4ae2970a81e88f40: start","job_status":"start","queue_duration_s":1.14536,"scheduling_latency_s":1.145373}1535gitlab # [ 176.221222] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:07.509Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9fe63bda4ae2970a81e88f40","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9fe63bda4ae2970a81e88f40: done: 0.290957 sec","job_status":"done","queue_duration_s":1.14536,"scheduling_latency_s":1.145373,"redis_calls":13,"redis_duration_s":0.27613299999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000781,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.275352,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010426,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.290957,"completed_at":"2026-08-20T08:52:07.509Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1536gitlab # [ 176.254646] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:07.543Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b533521886e76fa4adc7e65","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b533521886e76fa4adc7e65: start","job_status":"start","queue_duration_s":1.470036,"scheduling_latency_s":1.470078}1537gitlab # [ 176.285143] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:07.573Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b533521886e76fa4adc7e65","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b533521886e76fa4adc7e65: done: 0.030458 sec","job_status":"done","queue_duration_s":1.470036,"scheduling_latency_s":1.470078,"redis_calls":13,"redis_duration_s":0.002476,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000812,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001664,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014917,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030458,"completed_at":"2026-08-20T08:52:07.573Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1538gitlab # [ 176.318423] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:07.607Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fabdac31ae9fd97b19c148e9","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fabdac31ae9fd97b19c148e9: start","job_status":"start","queue_duration_s":1.533791,"scheduling_latency_s":1.533839}1539gitlab # [ 176.349512] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:07.637Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fabdac31ae9fd97b19c148e9","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fabdac31ae9fd97b19c148e9: done: 0.031068 sec","job_status":"done","queue_duration_s":1.533791,"scheduling_latency_s":1.533839,"redis_calls":13,"redis_duration_s":0.002581,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000832,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001749,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015024,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031068,"completed_at":"2026-08-20T08:52:07.637Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1540gitlab # [ 176.383745] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:07.671Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c89b9b1ea02d60f369abbcd","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c89b9b1ea02d60f369abbcd: start","job_status":"start","queue_duration_s":1.597836,"scheduling_latency_s":1.597874}1541gitlab # [ 176.406469] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:07.695Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c89b9b1ea02d60f369abbcd","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c89b9b1ea02d60f369abbcd: done: 0.02408 sec","job_status":"done","queue_duration_s":1.597836,"scheduling_latency_s":1.597874,"redis_calls":13,"redis_duration_s":0.0036049999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001162,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002443,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014046,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02408,"completed_at":"2026-08-20T08:52:07.694Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1542gitlab # [ 176.439618] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:07.728Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eca34ae5daaabca86d4f4b1d","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eca34ae5daaabca86d4f4b1d: start","job_status":"start","queue_duration_s":1.655088,"scheduling_latency_s":1.655178}1543gitlab # [ 176.469873] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:07.758Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eca34ae5daaabca86d4f4b1d","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eca34ae5daaabca86d4f4b1d: done: 0.030091 sec","job_status":"done","queue_duration_s":1.655088,"scheduling_latency_s":1.655178,"redis_calls":13,"redis_duration_s":0.002413,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000853,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00156,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014722,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030091,"completed_at":"2026-08-20T08:52:07.758Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1544gitlab # [ 176.502760] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:07.791Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ed474281a9bcfca93ad21782","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ed474281a9bcfca93ad21782: start","job_status":"start","queue_duration_s":1.718066,"scheduling_latency_s":1.718157}1545gitlab # [ 176.536103] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:07.824Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ed474281a9bcfca93ad21782","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ed474281a9bcfca93ad21782: done: 0.033489 sec","job_status":"done","queue_duration_s":1.718066,"scheduling_latency_s":1.718157,"redis_calls":13,"redis_duration_s":0.004205,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001414,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002791,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014967,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033489,"completed_at":"2026-08-20T08:52:07.824Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1546gitlab # [ 176.570480] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:07.859Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e3c2ff7b950685ab432a8ef","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e3c2ff7b950685ab432a8ef: start","job_status":"start","queue_duration_s":1.785887,"scheduling_latency_s":1.785925}1547gitlab # [ 176.594112] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:07.881Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e3c2ff7b950685ab432a8ef","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e3c2ff7b950685ab432a8ef: done: 0.022992 sec","job_status":"done","queue_duration_s":1.785887,"scheduling_latency_s":1.785925,"redis_calls":13,"redis_duration_s":0.003516,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001148,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002368,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013745,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022992,"completed_at":"2026-08-20T08:52:07.881Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1548gitlab # [ 176.627736] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:07.916Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08be865767b175d00eb639b6","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08be865767b175d00eb639b6: start","job_status":"start","queue_duration_s":1.843194,"scheduling_latency_s":1.843243}1549gitlab # [ 176.658262] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:07.946Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08be865767b175d00eb639b6","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08be865767b175d00eb639b6: done: 0.030512 sec","job_status":"done","queue_duration_s":1.843194,"scheduling_latency_s":1.843243,"redis_calls":13,"redis_duration_s":0.002617,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000931,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001686,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014834,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030512,"completed_at":"2026-08-20T08:52:07.946Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1550gitlab # [ 176.691962] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:07.980Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a8821b57cf57fdba96a82ad","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a8821b57cf57fdba96a82ad: start","job_status":"start","queue_duration_s":1.907544,"scheduling_latency_s":1.907582}1551gitlab # [ 176.715296] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:08.003Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a8821b57cf57fdba96a82ad","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a8821b57cf57fdba96a82ad: done: 0.023209 sec","job_status":"done","queue_duration_s":1.907544,"scheduling_latency_s":1.907582,"redis_calls":13,"redis_duration_s":0.0035250000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001123,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002402,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014686,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023209,"completed_at":"2026-08-20T08:52:08.003Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1552gitlab # [ 176.749279] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:08.037Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"69b5c17c42ec835b26eaa468","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-69b5c17c42ec835b26eaa468: start","job_status":"start","queue_duration_s":1.964758,"scheduling_latency_s":1.964797}1553gitlab # [ 176.780478] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:08.068Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"69b5c17c42ec835b26eaa468","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-69b5c17c42ec835b26eaa468: done: 0.030304 sec","job_status":"done","queue_duration_s":1.964758,"scheduling_latency_s":1.964797,"redis_calls":13,"redis_duration_s":0.002321,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00076,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001561,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014088,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030304,"completed_at":"2026-08-20T08:52:08.068Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1554gitlab # [ 176.813695] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:08.102Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55189e60128bda6068bd8d3d","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55189e60128bda6068bd8d3d: start","job_status":"start","queue_duration_s":2.029239,"scheduling_latency_s":2.029277}1555gitlab # [ 176.846989] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:08.135Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55189e60128bda6068bd8d3d","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55189e60128bda6068bd8d3d: done: 0.033337 sec","job_status":"done","queue_duration_s":2.029239,"scheduling_latency_s":2.029277,"redis_calls":13,"redis_duration_s":0.004588,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001788,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0028,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01524,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033337,"completed_at":"2026-08-20T08:52:08.135Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1556gitlab # [ 176.880066] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:08.168Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60726e66fede3a8d3e9a275f","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60726e66fede3a8d3e9a275f: start","job_status":"start","queue_duration_s":2.095653,"scheduling_latency_s":2.095689}1557gitlab # [ 176.902386] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:08.190Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60726e66fede3a8d3e9a275f","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60726e66fede3a8d3e9a275f: done: 0.022165 sec","job_status":"done","queue_duration_s":2.095653,"scheduling_latency_s":2.095689,"redis_calls":13,"redis_duration_s":0.002711,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0009,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001811,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014798,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022165,"completed_at":"2026-08-20T08:52:08.190Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1558gitlab # [ 176.935824] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:08.224Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9ba0e682abcc0a6e651a3af","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9ba0e682abcc0a6e651a3af: start","job_status":"start","queue_duration_s":2.151421,"scheduling_latency_s":2.151459}1559gitlab # [ 176.959916] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:08.248Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9ba0e682abcc0a6e651a3af","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9ba0e682abcc0a6e651a3af: done: 0.02398 sec","job_status":"done","queue_duration_s":2.151421,"scheduling_latency_s":2.151459,"redis_calls":13,"redis_duration_s":0.003763,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001251,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002512,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015259,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02398,"completed_at":"2026-08-20T08:52:08.248Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1560gitlab # [ 176.993663] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:08.281Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f63603935f359bfcbd2575f4","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f63603935f359bfcbd2575f4: start","job_status":"start","queue_duration_s":2.208371,"scheduling_latency_s":2.20841}1561gitlab # [ 177.028098] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:08.316Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f63603935f359bfcbd2575f4","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f63603935f359bfcbd2575f4: done: 0.035004 sec","job_status":"done","queue_duration_s":2.208371,"scheduling_latency_s":2.20841,"redis_calls":13,"redis_duration_s":0.002709,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000812,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001897,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015047,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035004,"completed_at":"2026-08-20T08:52:08.316Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1562gitlab # [ 177.061952] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:08.350Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c0d6907991c8e478a613cb9","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c0d6907991c8e478a613cb9: start","job_status":"start","queue_duration_s":2.277409,"scheduling_latency_s":2.277449}1563gitlab # [ 177.086701] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:08.375Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c0d6907991c8e478a613cb9","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c0d6907991c8e478a613cb9: done: 0.02488 sec","job_status":"done","queue_duration_s":2.277409,"scheduling_latency_s":2.277449,"redis_calls":13,"redis_duration_s":0.0037600000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001298,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002462,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01596,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02488,"completed_at":"2026-08-20T08:52:08.375Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1564gitlab # [ 177.120909] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:08.409Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89766381a02b94fd94a4d2f1","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89766381a02b94fd94a4d2f1: start","job_status":"start","queue_duration_s":2.336476,"scheduling_latency_s":2.336516}1565gitlab # [ 177.146281] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:08.434Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89766381a02b94fd94a4d2f1","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89766381a02b94fd94a4d2f1: done: 0.025236 sec","job_status":"done","queue_duration_s":2.336476,"scheduling_latency_s":2.336516,"redis_calls":13,"redis_duration_s":0.004289,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001301,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002988,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016313,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025236,"completed_at":"2026-08-20T08:52:08.434Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1566gitlab # [ 177.179602] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:08.468Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"611bad1d1c11755855cc5dee","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-611bad1d1c11755855cc5dee: start","job_status":"start","queue_duration_s":2.39497,"scheduling_latency_s":2.395009}1567gitlab # [ 177.211434] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:08.499Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"611bad1d1c11755855cc5dee","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-611bad1d1c11755855cc5dee: done: 0.031755 sec","job_status":"done","queue_duration_s":2.39497,"scheduling_latency_s":2.395009,"redis_calls":13,"redis_duration_s":0.0027210000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00093,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001791,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015783,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031755,"completed_at":"2026-08-20T08:52:08.499Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1568gitlab # [ 177.246817] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:08.534Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0bcea845acfaf75a34cc0e05","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0bcea845acfaf75a34cc0e05: start","job_status":"start","queue_duration_s":2.460829,"scheduling_latency_s":2.460879}1569gitlab # [ 177.272599] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:08.561Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0bcea845acfaf75a34cc0e05","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0bcea845acfaf75a34cc0e05: done: 0.027255 sec","job_status":"done","queue_duration_s":2.460829,"scheduling_latency_s":2.460879,"redis_calls":13,"redis_duration_s":0.003666,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001162,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002504,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015168,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027255,"completed_at":"2026-08-20T08:52:08.561Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1570gitlab # [ 177.306183] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:08.594Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"829456b150e10948200e5f55","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-829456b150e10948200e5f55: start","job_status":"start","queue_duration_s":2.521516,"scheduling_latency_s":2.521555}1571gitlab # [ 177.337690] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:08.626Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"829456b150e10948200e5f55","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-829456b150e10948200e5f55: done: 0.031501 sec","job_status":"done","queue_duration_s":2.521516,"scheduling_latency_s":2.521555,"redis_calls":13,"redis_duration_s":0.00265,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000901,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001749,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015555,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031501,"completed_at":"2026-08-20T08:52:08.626Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1572gitlab # [ 177.370346] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:08.658Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0839e6873acf9fe22848cd82","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0839e6873acf9fe22848cd82: start","job_status":"start","queue_duration_s":2.585717,"scheduling_latency_s":2.585756}1573gitlab # [ 177.407681] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:08.695Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0839e6873acf9fe22848cd82","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0839e6873acf9fe22848cd82: done: 0.03679 sec","job_status":"done","queue_duration_s":2.585717,"scheduling_latency_s":2.585756,"redis_calls":13,"redis_duration_s":0.005475,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001497,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003978,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015916,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03679,"completed_at":"2026-08-20T08:52:08.695Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1574gitlab # [ 177.439681] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:08.728Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fadb905d27d379ef0adb9171","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fadb905d27d379ef0adb9171: start","job_status":"start","queue_duration_s":2.655238,"scheduling_latency_s":2.655283}1575gitlab # [ 177.470898] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:08.759Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fadb905d27d379ef0adb9171","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fadb905d27d379ef0adb9171: done: 0.031023 sec","job_status":"done","queue_duration_s":2.655238,"scheduling_latency_s":2.655283,"redis_calls":13,"redis_duration_s":0.002652,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000884,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001768,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014916,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031023,"completed_at":"2026-08-20T08:52:08.759Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1576gitlab # [ 177.504185] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:08.792Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"849eb26309edf7ccd0a628e7","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-849eb26309edf7ccd0a628e7: start","job_status":"start","queue_duration_s":2.719485,"scheduling_latency_s":2.719535}1577gitlab # [ 177.536130] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:08.824Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"849eb26309edf7ccd0a628e7","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-849eb26309edf7ccd0a628e7: done: 0.032143 sec","job_status":"done","queue_duration_s":2.719485,"scheduling_latency_s":2.719535,"redis_calls":13,"redis_duration_s":0.002572,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000865,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001707,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015784,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032143,"completed_at":"2026-08-20T08:52:08.824Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1578gitlab # [ 177.555230] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:08.827Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01e8b245e4bbcf70e5e3cc1a","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01e8b245e4bbcf70e5e3cc1a: start","job_status":"start","queue_duration_s":2.753869,"scheduling_latency_s":2.7539}1579gitlab # [ 177.584068] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:08.872Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01e8b245e4bbcf70e5e3cc1a","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01e8b245e4bbcf70e5e3cc1a: done: 0.045569 sec","job_status":"done","queue_duration_s":2.753869,"scheduling_latency_s":2.7539,"redis_calls":13,"redis_duration_s":0.025706,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.02321,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002496,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015492,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.045569,"completed_at":"2026-08-20T08:52:08.872Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1580gitlab # [ 177.617886] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:08.906Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"784f44112f015528f11ac93a","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-784f44112f015528f11ac93a: start","job_status":"start","queue_duration_s":2.833261,"scheduling_latency_s":2.833303}1581gitlab # [ 177.643478] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:08.930Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"784f44112f015528f11ac93a","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-784f44112f015528f11ac93a: done: 0.024388 sec","job_status":"done","queue_duration_s":2.833261,"scheduling_latency_s":2.833303,"redis_calls":13,"redis_duration_s":0.0037600000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001208,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002552,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014757,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024388,"completed_at":"2026-08-20T08:52:08.930Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1582gitlab # [ 177.676831] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:08.965Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c046a27c92b164d950677c8","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c046a27c92b164d950677c8: start","job_status":"start","queue_duration_s":2.89224,"scheduling_latency_s":2.892281}1583gitlab # [ 177.708348] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:08.996Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c046a27c92b164d950677c8","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c046a27c92b164d950677c8: done: 0.031641 sec","job_status":"done","queue_duration_s":2.89224,"scheduling_latency_s":2.892281,"redis_calls":13,"redis_duration_s":0.002898,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000949,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001949,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015723,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031641,"completed_at":"2026-08-20T08:52:08.996Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1584gitlab # [ 177.727375] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:08.999Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a05fe271c6dc94e66fb537b1","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a05fe271c6dc94e66fb537b1: start","job_status":"start","queue_duration_s":2.926029,"scheduling_latency_s":2.926059}1585gitlab # [ 177.753927] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:09.042Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a05fe271c6dc94e66fb537b1","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a05fe271c6dc94e66fb537b1: done: 0.043329 sec","job_status":"done","queue_duration_s":2.926029,"scheduling_latency_s":2.926059,"redis_calls":13,"redis_duration_s":0.026253,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001099,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.025154,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012982,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.043329,"completed_at":"2026-08-20T08:52:09.042Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1586gitlab # [ 177.786715] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:09.075Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"16c2843bef879acc3782b56e","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-16c2843bef879acc3782b56e: start","job_status":"start","queue_duration_s":3.002068,"scheduling_latency_s":3.002165}1587gitlab # [ 177.818233] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:09.106Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"16c2843bef879acc3782b56e","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-16c2843bef879acc3782b56e: done: 0.031217 sec","job_status":"done","queue_duration_s":3.002068,"scheduling_latency_s":3.002165,"redis_calls":13,"redis_duration_s":0.002548,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00082,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001728,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01519,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031217,"completed_at":"2026-08-20T08:52:09.106Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1588gitlab # [ 177.854439] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:09.141Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc363c3fe12e53e30c8a5271","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc363c3fe12e53e30c8a5271: start","job_status":"start","queue_duration_s":3.068145,"scheduling_latency_s":3.068178}1589gitlab # [ 177.880344] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:09.168Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc363c3fe12e53e30c8a5271","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc363c3fe12e53e30c8a5271: done: 0.027768 sec","job_status":"done","queue_duration_s":3.068145,"scheduling_latency_s":3.068178,"redis_calls":13,"redis_duration_s":0.004209,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001476,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002733,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015875,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027768,"completed_at":"2026-08-20T08:52:09.168Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1590gitlab # [ 177.899664] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:09.171Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e000de90b695ab4ead1b96e0","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e000de90b695ab4ead1b96e0: start","job_status":"start","queue_duration_s":3.097964,"scheduling_latency_s":3.097988}1591gitlab # [ 177.929691] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:09.218Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e000de90b695ab4ead1b96e0","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e000de90b695ab4ead1b96e0: done: 0.047053 sec","job_status":"done","queue_duration_s":3.097964,"scheduling_latency_s":3.097988,"redis_calls":13,"redis_duration_s":0.028697,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.023954,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004743,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012465,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.047053,"completed_at":"2026-08-20T08:52:09.218Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1592gitlab # [ 177.963116] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:09.251Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"74a771c4475f91badf855eb8","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-74a771c4475f91badf855eb8: start","job_status":"start","queue_duration_s":3.178385,"scheduling_latency_s":3.178666}1593gitlab # [ 177.995201] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:09.283Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"74a771c4475f91badf855eb8","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-74a771c4475f91badf855eb8: done: 0.032077 sec","job_status":"done","queue_duration_s":3.178385,"scheduling_latency_s":3.178666,"redis_calls":13,"redis_duration_s":0.003241,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001465,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001776,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015515,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032077,"completed_at":"2026-08-20T08:52:09.283Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1594gitlab # [ 178.028946] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:09.317Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2bf7670d43250a4ae6311897","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2bf7670d43250a4ae6311897: start","job_status":"start","queue_duration_s":3.244357,"scheduling_latency_s":3.244407}1595gitlab # [ 178.054093] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:09.342Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2bf7670d43250a4ae6311897","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2bf7670d43250a4ae6311897: done: 0.025327 sec","job_status":"done","queue_duration_s":3.244357,"scheduling_latency_s":3.244407,"redis_calls":13,"redis_duration_s":0.003333,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00111,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002223,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015607,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025327,"completed_at":"2026-08-20T08:52:09.342Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1596gitlab # [ 178.087662] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:09.376Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"160044c3983bf898e3737cdb","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-160044c3983bf898e3737cdb: start","job_status":"start","queue_duration_s":3.302976,"scheduling_latency_s":3.303016}1597gitlab # [ 178.119243] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:09.407Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"160044c3983bf898e3737cdb","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-160044c3983bf898e3737cdb: done: 0.031398 sec","job_status":"done","queue_duration_s":3.302976,"scheduling_latency_s":3.303016,"redis_calls":13,"redis_duration_s":0.002628,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000881,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001747,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01498,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031398,"completed_at":"2026-08-20T08:52:09.407Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1598gitlab # [ 178.153468] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:09.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d86b848ff79d9ee5d42f2fc","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d86b848ff79d9ee5d42f2fc: start","job_status":"start","queue_duration_s":3.368674,"scheduling_latency_s":3.368723}1599gitlab # [ 178.178646] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:09.467Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d86b848ff79d9ee5d42f2fc","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d86b848ff79d9ee5d42f2fc: done: 0.025421 sec","job_status":"done","queue_duration_s":3.368674,"scheduling_latency_s":3.368723,"redis_calls":13,"redis_duration_s":0.0036680000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001185,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002483,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015419,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025421,"completed_at":"2026-08-20T08:52:09.467Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1600gitlab # [ 178.212168] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:09.500Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"778b041a7a3782e7e51bb483","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-778b041a7a3782e7e51bb483: start","job_status":"start","queue_duration_s":3.427596,"scheduling_latency_s":3.427635}1601gitlab # [ 178.243636] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:09.532Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"778b041a7a3782e7e51bb483","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-778b041a7a3782e7e51bb483: done: 0.031348 sec","job_status":"done","queue_duration_s":3.427596,"scheduling_latency_s":3.427635,"redis_calls":13,"redis_duration_s":0.0026899999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00089,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0018,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015316,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031348,"completed_at":"2026-08-20T08:52:09.531Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1602gitlab # [ 178.277138] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:09.565Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c12fbace57e2b25d9f88783","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c12fbace57e2b25d9f88783: start","job_status":"start","queue_duration_s":3.492476,"scheduling_latency_s":3.492525}1603gitlab # [ 178.309189] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:09.597Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c12fbace57e2b25d9f88783","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c12fbace57e2b25d9f88783: done: 0.032085 sec","job_status":"done","queue_duration_s":3.492476,"scheduling_latency_s":3.492525,"redis_calls":13,"redis_duration_s":0.002624,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000862,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001762,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015578,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032085,"completed_at":"2026-08-20T08:52:09.597Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1604gitlab # [ 178.342689] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:09.631Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"14933da185fe17f3e4f44b0e","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-14933da185fe17f3e4f44b0e: start","job_status":"start","queue_duration_s":3.55797,"scheduling_latency_s":3.558022}1605gitlab # [ 178.374175] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:09.662Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"14933da185fe17f3e4f44b0e","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-14933da185fe17f3e4f44b0e: done: 0.031275 sec","job_status":"done","queue_duration_s":3.55797,"scheduling_latency_s":3.558022,"redis_calls":13,"redis_duration_s":0.0025470000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000826,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001721,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015233,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031275,"completed_at":"2026-08-20T08:52:09.662Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1606gitlab # [ 178.409082] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:09.696Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c96e5406212a2a14b6d9d98","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c96e5406212a2a14b6d9d98: start","job_status":"start","queue_duration_s":3.623642,"scheduling_latency_s":3.623691}1607gitlab # [ 178.433573] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:09.722Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c96e5406212a2a14b6d9d98","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c96e5406212a2a14b6d9d98: done: 0.025408 sec","job_status":"done","queue_duration_s":3.623642,"scheduling_latency_s":3.623691,"redis_calls":13,"redis_duration_s":0.003926,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001482,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002444,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015482,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025408,"completed_at":"2026-08-20T08:52:09.722Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1608gitlab # [ 178.466833] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:09.755Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"76c5abc24692b5b11df103e1","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-76c5abc24692b5b11df103e1: start","job_status":"start","queue_duration_s":3.682253,"scheduling_latency_s":3.682293}1609gitlab # [ 178.498202] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:09.786Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"76c5abc24692b5b11df103e1","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-76c5abc24692b5b11df103e1: done: 0.03131 sec","job_status":"done","queue_duration_s":3.682253,"scheduling_latency_s":3.682293,"redis_calls":13,"redis_duration_s":0.002634,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000854,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00178,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015423,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03131,"completed_at":"2026-08-20T08:52:09.786Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1610gitlab # [ 178.531687] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:09.820Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2360d9adeefcf4d84e943ebc","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2360d9adeefcf4d84e943ebc: start","job_status":"start","queue_duration_s":3.747213,"scheduling_latency_s":3.747268}1611gitlab # [ 178.556297] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:09.844Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2360d9adeefcf4d84e943ebc","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2360d9adeefcf4d84e943ebc: done: 0.024582 sec","job_status":"done","queue_duration_s":3.747213,"scheduling_latency_s":3.747268,"redis_calls":13,"redis_duration_s":0.003976,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00129,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002686,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015504,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024582,"completed_at":"2026-08-20T08:52:09.844Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1612gitlab # [ 178.589456] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:09.878Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c44e13f3fb25cee61d5e64f0","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c44e13f3fb25cee61d5e64f0: start","job_status":"start","queue_duration_s":3.804832,"scheduling_latency_s":3.80487}1613gitlab # [ 178.620633] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:09.908Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c44e13f3fb25cee61d5e64f0","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c44e13f3fb25cee61d5e64f0: done: 0.030776 sec","job_status":"done","queue_duration_s":3.804832,"scheduling_latency_s":3.80487,"redis_calls":13,"redis_duration_s":0.002684,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000952,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001732,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014816,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030776,"completed_at":"2026-08-20T08:52:09.908Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1614gitlab # [ 178.653787] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:09.942Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c45ffb1185f7ec63f30c240","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c45ffb1185f7ec63f30c240: start","job_status":"start","queue_duration_s":3.869243,"scheduling_latency_s":3.869283}1615gitlab # [ 178.685134] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:09.973Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c45ffb1185f7ec63f30c240","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c45ffb1185f7ec63f30c240: done: 0.031151 sec","job_status":"done","queue_duration_s":3.869243,"scheduling_latency_s":3.869283,"redis_calls":13,"redis_duration_s":0.0029100000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000822,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002088,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015277,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031151,"completed_at":"2026-08-20T08:52:09.973Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1616gitlab # [ 178.717981] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:10.006Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"208679607549094e0f865dad","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-208679607549094e0f865dad: start","job_status":"start","queue_duration_s":3.933447,"scheduling_latency_s":3.933487}1617gitlab # [ 178.750088] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:10.038Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"208679607549094e0f865dad","created_at":"2026-08-20T08:52:05.929Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-dc97c406cf1a420f","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9704444c5979f61cebbb565eda4b35f7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.073Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-208679607549094e0f865dad: done: 0.031957 sec","job_status":"done","queue_duration_s":3.933447,"scheduling_latency_s":3.933487,"redis_calls":13,"redis_duration_s":0.002588,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000877,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001711,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016105,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031957,"completed_at":"2026-08-20T08:52:10.038Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1618gitlab # [ 178.783850] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:10.072Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a37c95ab6ba49f0526ead9b1","created_at":"2026-08-20T08:52:06.119Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-3bfce10b515b4430","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"17bbca113882bec3b8bbe44f6319eaa3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.124Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a37c95ab6ba49f0526ead9b1: start","job_status":"start","queue_duration_s":3.947766,"scheduling_latency_s":3.947817}1619gitlab # [ 178.802290] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:10.091Z","message":"No existing merge request to be cleaned up."}1620gitlab # [ 178.818695] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:10.106Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a37c95ab6ba49f0526ead9b1","created_at":"2026-08-20T08:52:06.119Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-3bfce10b515b4430","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"17bbca113882bec3b8bbe44f6319eaa3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.124Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a37c95ab6ba49f0526ead9b1: done: 0.034314 sec","job_status":"done","queue_duration_s":3.947766,"scheduling_latency_s":3.947817,"redis_calls":10,"redis_duration_s":0.004479,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001171,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003308,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021542,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034314,"completed_at":"2026-08-20T08:52:10.106Z","load_balancing_strategy":"primary","db_duration_s":0.002844,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1621gitlab # [ 178.851856] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:10.140Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f17449d8aa10f490917ec96e","created_at":"2026-08-20T08:52:06.119Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-3bfce10b515b4430","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"17bbca113882bec3b8bbe44f6319eaa3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.124Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f17449d8aa10f490917ec96e: start","job_status":"start","queue_duration_s":4.015843,"scheduling_latency_s":4.015887}1622gitlab # [ 178.868478] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:10.157Z","message":"No existing merge request to be cleaned up."}1623gitlab # [ 178.883818] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:10.172Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f17449d8aa10f490917ec96e","created_at":"2026-08-20T08:52:06.119Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-3bfce10b515b4430","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"17bbca113882bec3b8bbe44f6319eaa3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.124Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f17449d8aa10f490917ec96e: done: 0.031845 sec","job_status":"done","queue_duration_s":4.015843,"scheduling_latency_s":4.015887,"redis_calls":10,"redis_duration_s":0.004444,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001296,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003148,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020272,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031845,"completed_at":"2026-08-20T08:52:10.172Z","load_balancing_strategy":"primary","db_duration_s":0.001943,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1624gitlab # [ 178.916324] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:10.204Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f511b60ad2e519d218ebe31e","created_at":"2026-08-20T08:52:06.119Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-3bfce10b515b4430","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"17bbca113882bec3b8bbe44f6319eaa3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.124Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f511b60ad2e519d218ebe31e: start","job_status":"start","queue_duration_s":4.080286,"scheduling_latency_s":4.080327}1625gitlab # [ 178.941711] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:10.230Z","message":"No existing merge request to be cleaned up."}1626gitlab # [ 178.956410] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:10.244Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f511b60ad2e519d218ebe31e","created_at":"2026-08-20T08:52:06.119Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-3bfce10b515b4430","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"17bbca113882bec3b8bbe44f6319eaa3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.124Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f511b60ad2e519d218ebe31e: done: 0.040013 sec","job_status":"done","queue_duration_s":4.080286,"scheduling_latency_s":4.080327,"redis_calls":10,"redis_duration_s":0.003992,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000965,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003027,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020782,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040013,"completed_at":"2026-08-20T08:52:10.244Z","load_balancing_strategy":"primary","db_duration_s":0.00348,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1627gitlab # [ 178.989134] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:10.277Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5a88e0fd36f876aa1c56b2b6","created_at":"2026-08-20T08:52:06.119Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-3bfce10b515b4430","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"17bbca113882bec3b8bbe44f6319eaa3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.124Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5a88e0fd36f876aa1c56b2b6: start","job_status":"start","queue_duration_s":4.153017,"scheduling_latency_s":4.153058}1628gitlab # [ 179.013753] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:10.302Z","message":"No existing merge request to be cleaned up."}1629gitlab # [ 179.027411] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:10.315Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5a88e0fd36f876aa1c56b2b6","created_at":"2026-08-20T08:52:06.119Z","trace_propagation_headers":{"sentry-trace":"c6fb9e6c9292457699d0d16e03b18f0e-3bfce10b515b4430","baggage":"sentry-trace_id=c6fb9e6c9292457699d0d16e03b18f0e,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"17bbca113882bec3b8bbe44f6319eaa3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:06.124Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"maed","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5a88e0fd36f876aa1c56b2b6: done: 0.038234 sec","job_status":"done","queue_duration_s":4.153017,"scheduling_latency_s":4.153058,"redis_calls":10,"redis_duration_s":0.0039299999999999995,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000971,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002959,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018583,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038234,"completed_at":"2026-08-20T08:52:10.315Z","load_balancing_strategy":"primary","db_duration_s":0.003317,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1630gitlab # [ 182.846265] postgres[2414]: [2414] ERROR: relation "table_without_models" does not exist1631gitlab # [ 182.847371] postgres[2414]: [2414] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1632gitlab # [ 185.826162] runuser[2218]: pam_unix(runuser:session): session closed for user gitlab1633gitlab # [ 185.827552] setup-gitlab-start[2193]: + systemctl restart gitlab-sidekiq.service1634gitlab # [ 185.849060] systemd[1]: Stopping gitlab-sidekiq.service...1635gitlab # [ 185.850609] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:17.139Z","message":"Shutting down"}1636gitlab # [ 185.851676] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:17.139Z","message":"Scheduler exiting..."}1637gitlab # [ 185.852655] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:17.140Z","message":"Terminating quiet threads for default capsule"}1638gitlab # [ 185.853766] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:17.140Z","message":"Scheduler exiting..."}1639gitlab # [ 186.353204] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:17.641Z","message":"Pausing to allow jobs to finish..."}1640gitlab # [ 189.357715] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:20.645Z","message":"Bye!"}1641gitlab # [ 189.384746] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-08-20T08:52:20.673Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1613,"worker_id":"sidekiq_0","memwd_rss_bytes":941207552,"retry":0}1642gitlab # [ 190.165696] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1643gitlab # [ 190.168070] systemd[1]: Stopped gitlab-sidekiq.service.1644gitlab # [ 190.169776] systemd[1]: gitlab-sidekiq.service: Consumed 58.945s CPU time over 1min 57.068s wall clock time, 956.3M memory peak, 4.4M read from disk.1645gitlab # [ 190.174095] systemd[1]: Started gitlab-sidekiq.service.1646gitlab # [ 190.176356] setup-gitlab-start[2193]: + mkdir -p /var/lib/secrets1647gitlab # [ 190.179338] setup-gitlab-start[2193]: + echo nixbot-test-token-of-20-chars1648gitlab # [ 190.181458] setup-gitlab-start[2193]: + chmod 644 /var/lib/secrets/gitlab-token1649gitlab # [ 190.184381] setup-gitlab-start[2193]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1650gitlab # [ 191.148393] gitaly[920]: time="2026-08-20T08:52:22.436Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5Y3VM7J75GQ2J8A1CNFGN error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:52:32.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:52:22.436" pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1651gitlab # [ 191.150822] gitaly[920]: time="2026-08-20T08:52:22.437Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5Y3VM7J75GQ2J8A1CNFGN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:52:32.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:52:22.436" grpc.time_ms=0.425 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1652gitlab # [ 191.346304] gitaly[920]: time="2026-08-20T08:52:22.635Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5Y3VM7J75GQ2J8A1CNFGN error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:52:32.204" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:52:22.634" pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1653gitlab # [ 191.363719] gitaly[920]: time="2026-08-20T08:52:22.635Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5Y3VM7J75GQ2J8A1CNFGN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:52:32.204" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:52:22.634" grpc.time_ms=0.434 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1654gitlab # [ 191.410872] gitaly[920]: time="2026-08-20T08:52:22.699Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5Y3VM7J75GQ2J8A1CNFGN diskcache=8c3af133-b9ed-4ef0-a21c-efbbb30428f7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T08:52:32.214" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:52:22.645" pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1655gitlab # [ 191.412068] gitaly[920]: time="2026-08-20T08:52:22.700Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1580 command.oublock=32 command.real_time_ms=26 command.spawn_token_fork_ms=11 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5Y3VM7J75GQ2J8A1CNFGN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T08:52:32.214" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:52:22.645" grpc.time_ms=53.972 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1656gitlab # [ 191.446399] gitaly[920]: time="2026-08-20T08:52:22.735Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5Y3VM7J75GQ2J8A1CNFGN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:52:32.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:52:22.735" pid=920 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1657gitlab # [ 191.447560] gitaly[920]: time="2026-08-20T08:52:22.735Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5Y3VM7J75GQ2J8A1CNFGN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:52:32.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:52:22.735" grpc.time_ms=0.407 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1658gitlab # [ 191.485622] gitaly[920]: time="2026-08-20T08:52:22.774Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5Y3VM7J75GQ2J8A1CNFGN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T08:52:32.029" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:52:22.759" grpc.time_ms=14.897 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1659gitlab # [ 191.565137] gitaly[920]: time="2026-08-20T08:52:22.854Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5Y3VM7J75GQ2J8A1CNFGN error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:52:32.123" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:52:22.853" pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1660gitlab # [ 191.585426] gitaly[920]: time="2026-08-20T08:52:22.854Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5Y3VM7J75GQ2J8A1CNFGN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:52:32.123" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:52:22.853" grpc.time_ms=0.43 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1661gitlab # [ 191.662572] gitaly[920]: time="2026-08-20T08:52:22.951Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5Y3VM7J75GQ2J8A1CNFGN diskcache=092bd7f3-44b6-4337-aa35-a4ced01d225c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T08:52:32.167" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:52:22.897" pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1662gitlab # [ 191.683292] gitaly[920]: time="2026-08-20T08:52:22.951Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1577 command.oublock=32 command.real_time_ms=23 command.spawn_token_fork_ms=1 command.system_time_ms=14 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5Y3VM7J75GQ2J8A1CNFGN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T08:52:32.167" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:52:22.897" grpc.time_ms=53.693 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1663gitlab # [ 191.684970] gitaly[920]: time="2026-08-20T08:52:22.962Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5Y3VM7J75GQ2J8A1CNFGN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:52:32.231" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:52:22.962" pid=920 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1664gitlab # [ 191.687736] gitaly[920]: time="2026-08-20T08:52:22.963Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5Y3VM7J75GQ2J8A1CNFGN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:52:32.231" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:52:22.962" grpc.time_ms=1.004 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1665gitlab # [ 191.692491] gitaly[920]: time="2026-08-20T08:52:22.981Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5Y3VM7J75GQ2J8A1CNFGN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T08:52:32.237" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:52:22.968" grpc.time_ms=12.33 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1666gitlab # [ 191.726585] gitaly[920]: time="2026-08-20T08:52:23.015Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5Y3VM7J75GQ2J8A1CNFGN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:52:33.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:52:23.014" grpc.time_ms=0.212 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1667gitlab # [ 191.733951] gitaly[920]: time="2026-08-20T08:52:23.022Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5Y3VM7J75GQ2J8A1CNFGN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T08:52:33.012" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:52:23.022" grpc.time_ms=0.228 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1668gitlab # [ 192.150421] gitaly[920]: time="2026-08-20T08:52:23.438Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5Y3VM7J75GQ2J8A1CNFGN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T08:52:33.001" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:52:23.432" grpc.time_ms=6.213 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1669gitlab # [ 192.534910] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:52:23 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 23301670gitlab # [ 192.541777] setup-gitlab-start[2193]: + mkdir -p /tmp/test-flake1671gitlab # [ 192.546210] setup-gitlab-start[2193]: + cd /tmp/test-flake1672gitlab # [ 192.547925] setup-gitlab-start[2193]: + git init -b master1673gitlab # [ 192.574499] setup-gitlab-start[2509]: Initialized empty Git repository in /tmp/test-flake/.git/1674gitlab # [ 192.577187] setup-gitlab-start[2193]: + git config user.name test1675gitlab # [ 192.579644] setup-gitlab-start[2193]: + git config user.email test@example.com1676gitlab # [ 192.584261] setup-gitlab-start[2193]: + cat1677gitlab # [ 192.588986] setup-gitlab-start[2193]: + git add flake.nix1678gitlab # [ 192.596220] setup-gitlab-start[2193]: + git commit -m 'initial commit'1679gitlab # [ 192.607401] setup-gitlab-start[2514]: [master (root-commit) 9494aaa] initial commit1680gitlab # [ 192.609182] setup-gitlab-start[2514]: 1 file changed, 10 insertions(+)1681gitlab # [ 192.611228] setup-gitlab-start[2514]: create mode 100644 flake.nix1682gitlab # [ 192.612899] setup-gitlab-start[2193]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1683gitlab # [ 192.614481] setup-gitlab-start[2193]: + git push -u origin master1684gitlab # [ 192.748621] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:52:24 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 1191685gitlab # [ 192.973658] gitaly[920]: time="2026-08-20T08:52:24.262Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0F5Y6BBWWGAZVG5QCTR0KHK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:52:24.250" grpc.time_ms=11.835 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1686gitlab # [ 192.976487] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:52:24 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 2211687gitlab # [ 193.247407] gitaly[920]: time="2026-08-20T08:52:24.536Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T08:52:34.095" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:52:24.525" grpc.time_ms=10.418 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1688gitlab # [ 193.300560] gitaly[920]: time="2026-08-20T08:52:24.589Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=327 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-20T08:52:54.081" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-20T08:52:24.581" grpc.time_ms=7.64 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1689gitlab # [ 193.310568] sidekiq-cluster[2457]: {"severity":"INFO","time":"2026-08-20T08:52:24.580Z","message":"Starting cluster with 1 processes"}1690gitlab # [ 193.333083] gitaly[920]: time="2026-08-20T08:52:24.614Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N duration_ms=171ns method=POST pid=920 status=200 url="http://unix/api/v4/internal/allowed"1691gitlab # [ 193.349663] gitaly[920]: time="2026-08-20T08:52:24.638Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N duration_ms=23ns method=POST pid=920 status=200 url="http://unix/api/v4/internal/pre_receive"1692gitlab # [ 193.354657] gitaly[920]: time="2026-08-20T08:52:24.643Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5309 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:52:24.442" grpc.time_ms=201.695 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1693gitlab # [ 193.392562] gitaly[920]: time="2026-08-20T08:52:24.681Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4779 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:52:24.680" grpc.time_ms=0.514 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1694gitlab # [ 193.424740] gitaly[920]: time="2026-08-20T08:52:24.713Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4778 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:52:24.713" grpc.time_ms=0.504 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1695gitlab # [ 193.452315] gitaly[920]: time="2026-08-20T08:52:24.741Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4780 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:52:24.741" grpc.time_ms=0.368 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1696gitlab # [ 193.528207] gitaly[920]: time="2026-08-20T08:52:24.817Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T08:52:34.078" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:52:24.808" grpc.time_ms=8.208 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1697gitlab # [ 193.566851] gitaly[920]: time="2026-08-20T08:52:24.855Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1574 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-20T08:52:34.110" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:52:24.841" grpc.time_ms=14.096 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1698gitlab # [ 193.589735] gitaly[920]: time="2026-08-20T08:52:24.878Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N duration_ms=109ns method=POST pid=920 status=200 url="http://unix/api/v4/internal/post_receive"1699gitlab # [ 193.590602] gitaly[920]: time="2026-08-20T08:52:24.879Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4803 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:52:24.768" grpc.time_ms=110.712 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1700gitlab # [ 193.611365] gitaly[920]: time="2026-08-20T08:52:24.900Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N diskcache=cf44addc-00f6-4a1d-ae0f-71f0775b0afc grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:52:24.358" pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1701gitlab # [ 193.612297] gitaly[920]: time="2026-08-20T08:52:24.900Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=198 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13709 command.oublock=32 command.real_time_ms=532 command.spawn_token_fork_ms=0 command.system_time_ms=127 command.user_time_ms=71 component=gitaly.StreamServerInterceptor correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:52:24.358" grpc.time_ms=541.842 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1702gitlab # [ 193.630798] gitlab-workhorse[824]: time="2026-08-20T08:52:24Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521703gitlab # [ 193.631574] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:52:24 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 6161704gitlab # [ 193.634913] setup-gitlab-start[2518]: To http://gitlab/root/test-flake.git1705gitlab # [ 193.636069] setup-gitlab-start[2518]: * [new branch] master -> master1706gitlab # [ 193.639314] setup-gitlab-start[2518]: branch 'master' set up to track 'origin/master'.1707gitlab # [ 193.643150] systemd[1]: Finished setup-gitlab.service.1708gitlab # [ 193.648113] systemd[1]: Starting nixbot CI service...1709gitlab: (finished: waiting for unit setup-gitlab.service, in 195.05 seconds)1710gitlab: waiting for unit nixbot.service1711gitlab # [ 194.779426] nixbot[2605]: {"ts": "2026-08-20T08:52:26.067Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1712gitlab # [ 194.806464] nixbot[2605]: {"ts": "2026-08-20T08:52:26.095Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1713gitlab # [ 194.829348] nixbot[2605]: {"ts": "2026-08-20T08:52:26.118Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1714gitlab # [ 194.835068] nixbot[2605]: {"ts": "2026-08-20T08:52:26.123Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1715gitlab # [ 194.839730] nixbot[2605]: {"ts": "2026-08-20T08:52:26.128Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1716gitlab # [ 194.846063] nixbot[2605]: {"ts": "2026-08-20T08:52:26.135Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1717gitlab # [ 194.851841] nixbot[2605]: {"ts": "2026-08-20T08:52:26.140Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1718gitlab # [ 194.856319] nixbot[2605]: {"ts": "2026-08-20T08:52:26.145Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1719gitlab # [ 194.862752] nixbot[2605]: {"ts": "2026-08-20T08:52:26.151Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1720gitlab # [ 194.866770] nixbot[2605]: {"ts": "2026-08-20T08:52:26.155Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1721gitlab # [ 194.874836] nixbot[2605]: {"ts": "2026-08-20T08:52:26.163Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1722gitlab # [ 194.886093] nixbot[2605]: {"ts": "2026-08-20T08:52:26.175Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1723gitlab # [ 194.890931] nixbot[2605]: {"ts": "2026-08-20T08:52:26.179Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1724gitlab # [ 194.895719] nixbot[2605]: {"ts": "2026-08-20T08:52:26.184Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1725gitlab # [ 194.900714] nixbot[2605]: {"ts": "2026-08-20T08:52:26.189Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1726gitlab # [ 194.904685] nixbot[2605]: {"ts": "2026-08-20T08:52:26.193Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1727gitlab # [ 194.908686] nixbot[2605]: {"ts": "2026-08-20T08:52:26.197Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1728gitlab # [ 194.912468] nixbot[2605]: {"ts": "2026-08-20T08:52:26.201Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1729gitlab # [ 194.917888] nixbot[2605]: {"ts": "2026-08-20T08:52:26.206Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1730gitlab # [ 194.921706] nixbot[2605]: {"ts": "2026-08-20T08:52:26.210Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1731gitlab # [ 194.925489] nixbot[2605]: {"ts": "2026-08-20T08:52:26.214Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1732gitlab # [ 194.930928] nixbot[2605]: {"ts": "2026-08-20T08:52:26.219Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1733gitlab # [ 194.934801] nixbot[2605]: {"ts": "2026-08-20T08:52:26.223Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1734gitlab # [ 194.938758] nixbot[2605]: {"ts": "2026-08-20T08:52:26.227Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1735gitlab # [ 194.942403] nixbot[2605]: {"ts": "2026-08-20T08:52:26.231Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1736gitlab # [ 195.223257] nixbot[2605]: INFO: Started server process [2605]1737gitlab # [ 195.225246] nixbot[2605]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1738gitlab # [ 195.238547] nixbot[2605]: INFO: ::ffff:127.0.0.1:56328 - "GET /health HTTP/1.1" 200 OK1739gitlab # [ 195.246877] systemd[1]: Started nixbot CI service.1740gitlab # [ 195.251528] systemd[1]: Reached target Multi-User System.1741gitlab # [ 195.254154] systemd[1]: Startup finished in 1.243s (kernel) + 3.573s (initrd) + 3min 10.436s (userspace) = 3min 15.253s.1742gitlab: (finished: waiting for unit nixbot.service, in 1.05 seconds)1743gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1744gitlab # [ 195.524275] nixbot[2605]: INFO: ::ffff:127.0.0.1:56330 - "GET /health HTTP/1.1" 200 OK1745gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.03 seconds)1746subtest: project discovered and webhook registered1747gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1748gitlab # [ 195.609247] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:52:26 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 571749gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.09 seconds)1750gitlab # [ 195.955274] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:52:27 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 7141751gitlab # [ 195.962443] nixbot[2605]: {"ts": "2026-08-20T08:52:27.250Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1752gitlab # [ 195.983925] nixbot[2605]: {"ts": "2026-08-20T08:52:27.272Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1753gitlab # [ 196.079079] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:52:27 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 811754gitlab # [ 196.084654] nixbot[2605]: {"ts": "2026-08-20T08:52:27.373Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1755gitlab # [ 196.086196] nixbot[2605]: {"ts": "2026-08-20T08:52:27.374Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1756gitlab # [ 196.264958] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:52:27 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 1701757gitlab # [ 196.269730] nixbot[2605]: {"ts": "2026-08-20T08:52:27.555Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1758gitlab # [ 196.398874] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:52:27 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1221759gitlab # [ 196.404163] nixbot[2605]: {"ts": "2026-08-20T08:52:27.688Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1760gitlab # [ 196.504816] nixbot[2605]: {"ts": "2026-08-20T08:52:27.793Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1761gitlab # [ 196.510137] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:52:27 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 951762gitlab # [ 196.556974] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:52:27 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 461763gitlab # [ 196.561683] nixbot[2605]: {"ts": "2026-08-20T08:52:27.846Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1764gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1765gitlab # [ 196.610519] gitaly[920]: time="2026-08-20T08:52:27.898Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=3 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YA2APVBNAR5ZDPKM3KKR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-20T08:52:57.382" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:52:27.882" grpc.time_ms=15.485 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1766gitlab # [ 196.644217] gitaly[920]: time="2026-08-20T08:52:27.909Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YA2APVBNAR5ZDPKM3KKR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:52:57.408" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:52:27.908" grpc.time_ms=0.486 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1767gitlab # [ 196.662128] gitaly[920]: time="2026-08-20T08:52:27.943Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YA2APVBNAR5ZDPKM3KKR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-20T08:52:37.206" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:52:27.936" grpc.time_ms=6.486 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1768gitlab # [ 196.683100] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:52:27 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 1201769gitlab # [ 196.685173] nixbot[2605]: {"ts": "2026-08-20T08:52:27.972Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1770gitlab # [ 196.699800] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:52:27 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 421771gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.09 seconds)1772(finished: subtest: project discovered and webhook registered, in 1.18 seconds)1773subtest: push delivers the webhook1774gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1775gitlab # [ 196.750660] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:52:28 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 201776gitlab # [ 196.802708] gitaly[920]: time="2026-08-20T08:52:28.091Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=3 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0F5YA88VCHYKS0VFWK2N9MT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:52:28.084" grpc.time_ms=6.747 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1777gitlab # [ 196.831532] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:52:28 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 791778gitlab # [ 196.835381] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:52:28 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1471779gitlab # [ 196.839423] nixbot[2605]: {"ts": "2026-08-20T08:52:28.124Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1780gitlab # [ 196.843884] nixbot[2605]: {"ts": "2026-08-20T08:52:28.127Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1781gitlab # Enumerating objects: 5, done.1782gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1783gitlab # Delta compression using up to 4 threads1784gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1785gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 273.00 KiB/s, done.1786gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1787gitlab # [ 196.927089] gitaly[920]: time="2026-08-20T08:52:28.216Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M0F5YABWC0X2R11ZE6TM1DGF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:52:28.203" grpc.time_ms=12.059 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc1788gitlab # [ 196.950924] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:52:28 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 831789gitlab # [ 197.027077] gitaly[920]: time="2026-08-20T08:52:28.316Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YAENPCGYPWH488E1RHC8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:52:28.306" pid=920 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1790gitlab # [ 197.032822] gitaly[920]: time="2026-08-20T08:52:28.321Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=328 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F5YABGHEET032Y6TE1W821 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-20T08:52:58.014" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-20T08:52:28.314" grpc.time_ms=7.086 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1791gitlab # [ 197.048570] gitaly[920]: time="2026-08-20T08:52:28.337Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M0F5YABGHEET032Y6TE1W821 duration_ms=88ns method=POST pid=920 status=200 url="http://unix/api/v4/internal/allowed"1792gitlab # [ 197.069290] gitaly[920]: time="2026-08-20T08:52:28.358Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M0F5YABGHEET032Y6TE1W821 duration_ms=19ns method=POST pid=920 status=200 url="http://unix/api/v4/internal/pre_receive"1793gitlab # [ 197.073297] gitaly[920]: time="2026-08-20T08:52:28.359Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F5YABGHEET032Y6TE1W821 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5309 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:52:28.248" grpc.time_ms=110.581 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1794gitlab # [ 197.084169] gitaly[920]: time="2026-08-20T08:52:28.373Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YAENPCGYPWH488E1RHC8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:52:28.306" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc1795gitlab # [ 197.084978] gitaly[920]: time="2026-08-20T08:52:28.374Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YAENPCGYPWH488E1RHC8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:52:28.306" grpc.time_ms=67.096 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc1796gitlab # [ 197.086301] gitlab-workhorse[824]: time="2026-08-20T08:52:28Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131797gitlab # [ 197.086826] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:52:28 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1301798gitlab # [ 197.115606] gitaly[920]: time="2026-08-20T08:52:28.404Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F5YABGHEET032Y6TE1W821 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4779 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:52:28.404" grpc.time_ms=0.476 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1799gitlab # [ 197.150474] gitaly[920]: time="2026-08-20T08:52:28.439Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F5YABGHEET032Y6TE1W821 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4778 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:52:28.438" grpc.time_ms=0.598 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1800gitlab # [ 197.180030] gitaly[920]: time="2026-08-20T08:52:28.468Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F5YABGHEET032Y6TE1W821 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4780 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:52:28.466" grpc.time_ms=2.329 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1801gitlab # [ 197.185876] gitaly[920]: time="2026-08-20T08:52:28.475Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YAKHFBCEQXN1MNNH6VA1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:52:28.464" pid=920 remote_ip="2001:db8:1::1" request_sha=ee67073d69059954ec591074cd033a461ddd348d response_bytes=224 span.kind=server system=grpc1802gitlab # [ 197.186638] gitaly[920]: time="2026-08-20T08:52:28.475Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1200 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YAKHFBCEQXN1MNNH6VA1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:52:28.464" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc1803gitlab # [ 197.187205] gitlab-workhorse[824]: time="2026-08-20T08:52:28Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2241804gitlab # [ 197.187577] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:52:28 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 224 "" "git/2.55.0" 741805gitlab # [ 197.188073] gitaly[920]: time="2026-08-20T08:52:28.475Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1200 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YAKHFBCEQXN1MNNH6VA1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:52:28.464" grpc.time_ms=10.837 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc1806gitlab # [ 197.291421] gitaly[920]: time="2026-08-20T08:52:28.580Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0F5YAQT294QP72BB0XT0EN5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:52:28.574" grpc.time_ms=6.156 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc1807gitlab # [ 197.293263] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:52:28 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 421808gitlab # [ 197.302765] gitaly[920]: time="2026-08-20T08:52:28.591Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M0F5YABGHEET032Y6TE1W821 duration_ms=63ns method=POST pid=920 status=200 url="http://unix/api/v4/internal/post_receive"1809gitlab # [ 197.303859] gitaly[920]: time="2026-08-20T08:52:28.593Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F5YABGHEET032Y6TE1W821 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4803 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:52:28.528" grpc.time_ms=64.69 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1810gitlab # [ 197.324805] gitaly[920]: time="2026-08-20T08:52:28.613Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M0F5YABGHEET032Y6TE1W821 diskcache=d76c6ed7-1d75-423a-97ec-5b0098e37918 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:52:28.203" pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1811gitlab # [ 197.332947] gitaly[920]: time="2026-08-20T08:52:28.614Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=113 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=892928 command.minflt=13362 command.oublock=32 command.real_time_ms=402 command.spawn_token_fork_ms=1 command.system_time_ms=76 command.user_time_ms=37 component=gitaly.StreamServerInterceptor correlation_id=01M0F5YABGHEET032Y6TE1W821 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:52:28.203" grpc.time_ms=410.883 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1812gitlab # To http://gitlab/root/test-flake.git1813gitlab # 9494aaa..361c5ea master -> master1814gitlab # [ 197.345291] gitlab-workhorse[824]: time="2026-08-20T08:52:28Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521815gitlab # [ 197.345831] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:52:28 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 4691816gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.65 seconds)1817gitlab: must succeed: git -C /tmp/test-flake rev-parse master1818gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1819gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'1820gitlab # [ 197.368565] gitaly[920]: time="2026-08-20T08:52:28.657Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YASY0MP3NNTHJG08VT3H grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:52:28.650" pid=920 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1821gitlab # [ 197.369327] gitaly[920]: time="2026-08-20T08:52:28.657Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YASY0MP3NNTHJG08VT3H grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:52:28.650" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc1822gitlab # [ 197.371084] gitaly[920]: time="2026-08-20T08:52:28.658Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YASY0MP3NNTHJG08VT3H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:52:28.650" grpc.time_ms=7.242 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc1823gitlab # [ 197.371698] gitlab-workhorse[824]: time="2026-08-20T08:52:28Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671824gitlab # [ 197.372139] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:52:28 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 521825gitlab # [ 197.413804] nixbot[2605]: INFO: ::ffff:127.0.0.1:56346 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK1826gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.05 seconds)1827gitlab # [ 197.452477] gitaly[920]: time="2026-08-20T08:52:28.741Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YAWKJJQ0JPQ9M0Q5A8TC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:52:28.730" pid=920 remote_ip="2001:db8:1::1" request_sha=f547f944db0b36be6a4779d4b7bc1d3456630b55 response_bytes=336 span.kind=server system=grpc1828gitlab # [ 197.453079] gitaly[920]: time="2026-08-20T08:52:28.741Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1191 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YAWKJJQ0JPQ9M0Q5A8TC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:52:28.730" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc1829gitlab # [ 197.453674] gitaly[920]: time="2026-08-20T08:52:28.742Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1191 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YAWKJJQ0JPQ9M0Q5A8TC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:52:28.730" grpc.time_ms=11.832 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc1830gitlab # [ 197.453934] gitlab-workhorse[824]: time="2026-08-20T08:52:28Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3361831gitlab # [ 197.454459] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:52:28 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 336 "" "git/2.55.0" 501832gitlab # [ 197.561346] gitaly[920]: time="2026-08-20T08:52:28.850Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F5YB09ZPE4X052BHMY4NT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:52:28.842" grpc.time_ms=7.478 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc1833gitlab # [ 197.581654] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:52:28 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 611834gitlab # [ 197.653598] gitaly[920]: time="2026-08-20T08:52:28.942Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YB291RKCX5JJDT2CTPXW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:52:28.927" pid=920 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1835gitlab # [ 197.654966] gitaly[920]: time="2026-08-20T08:52:28.942Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1169 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YB291RKCX5JJDT2CTPXW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:52:28.927" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc1836gitlab # [ 197.656343] gitaly[920]: time="2026-08-20T08:52:28.942Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1169 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YB291RKCX5JJDT2CTPXW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:52:28.927" grpc.time_ms=14.771 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc1837gitlab # [ 197.705989] gitlab-workhorse[824]: time="2026-08-20T08:52:28Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091838gitlab # [ 197.706803] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:52:28 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 1211839gitlab # [ 197.802281] gitaly[920]: time="2026-08-20T08:52:29.091Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YB7EGS4WK7HWWG5MRVQC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:52:59.089" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:52:29.090" grpc.time_ms=0.942 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1840gitlab # [ 197.862747] gitaly[920]: time="2026-08-20T08:52:29.151Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=651 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F5YB7EGS4WK7HWWG5MRVQC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-20T08:52:59.141" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:52:29.141" grpc.time_ms=9.33 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1841gitlab # [ 197.879267] gitaly[920]: time="2026-08-20T08:52:29.168Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F5YB7EGS4WK7HWWG5MRVQC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:52:39.151" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:52:29.162" grpc.time_ms=6.125 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1842gitlab # [ 197.922602] gitaly[920]: time="2026-08-20T08:52:29.211Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F5YB7EGS4WK7HWWG5MRVQC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:52:39.195" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:52:29.205" grpc.time_ms=5.853 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1843gitlab # [ 197.977693] gitaly[920]: time="2026-08-20T08:52:29.266Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YB7EGS4WK7HWWG5MRVQC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T08:52:39.255" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:52:29.266" grpc.time_ms=0.44 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1844gitlab # [ 198.016650] gitaly[920]: time="2026-08-20T08:52:29.305Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YB7EGS4WK7HWWG5MRVQC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T08:52:39.283" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:52:29.293" grpc.time_ms=11.517 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1845gitlab # [ 198.065905] gitaly[920]: time="2026-08-20T08:52:29.354Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F5YB7EGS4WK7HWWG5MRVQC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:52:29.354" grpc.time_ms=0.747 pid=920 span.kind=server system=grpc1846gitlab # [ 198.111623] gitaly[920]: time="2026-08-20T08:52:29.400Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F5YB7EGS4WK7HWWG5MRVQC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:52:29.400" grpc.time_ms=0.526 pid=920 span.kind=server system=grpc1847gitlab # [ 198.131205] gitaly[920]: time="2026-08-20T08:52:29.420Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YB7EGS4WK7HWWG5MRVQC diskcache=8f06109d-b8bd-4c38-97e2-4b5f150b9ce6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T08:52:39.298" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:52:29.309" pid=920 ref=refs/keep-around/9494aaa3888aca4a4baa3113363b88e142f740a7 remote_ip="2001:db8:1::1" revision=9494aaa3888aca4a4baa3113363b88e142f740a7 span.kind=server system=grpc username=root1848gitlab # [ 198.140553] gitaly[920]: time="2026-08-20T08:52:29.429Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=86 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5392 command.oublock=8 command.real_time_ms=101 command.spawn_token_fork_ms=0 command.system_time_ms=57 command.user_time_ms=29 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YB7EGS4WK7HWWG5MRVQC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T08:52:39.298" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:52:29.309" grpc.time_ms=111.344 pid=920 ref=refs/keep-around/9494aaa3888aca4a4baa3113363b88e142f740a7 remote_ip="2001:db8:1::1" revision=9494aaa3888aca4a4baa3113363b88e142f740a7 span.kind=server system=grpc username=root1849gitlab # [ 198.156915] gitaly[920]: time="2026-08-20T08:52:29.446Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YB7EGS4WK7HWWG5MRVQC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:52:59.444" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:52:29.445" grpc.time_ms=0.438 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1850gitlab # [ 198.294787] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:52:29 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/9494aaa3888aca4a4baa3113363b88e142f740a7 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 5451851gitlab # [ 198.296372] nixbot[2605]: {"ts": "2026-08-20T08:52:29.584Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/9494aaa3888aca4a4baa3113363b88e142f740a7 \"HTTP/1.1 201 Created\""}1852gitlab # [ 198.304964] nixbot[2605]: {"ts": "2026-08-20T08:52:29.593Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-9494aaa3888a-0"}1853gitlab # [ 198.347780] systemd[1]: Started Nix Daemon.1854gitlab # [ 198.390648] nix-daemon[2824]: accepted connection from pid 2818, user nixbot1855gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'1856gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.02 seconds)1857gitlab # [ 198.441256] nixbot[2605]: INFO: ::ffff:127.0.0.1:56354 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK1858gitlab # [ 198.478579] nix-daemon[2824]: accepted connection from pid 2831, user nixbot1859gitlab # [ 198.495170] nixbot[2605]: {"ts": "2026-08-20T08:52:29.784Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-9494aaa3888a-0", "argv0": "bwrap"}1860gitlab # [ 198.624850] nix-daemon[2824]: accepted connection from pid 2844, user nixbot1861gitlab # [ 198.672726] nix-daemon[2824]: accepted connection from pid 2854, user nixbot1862gitlab # [ 198.687613] nix-daemon[2824]: accepted connection from pid 2844, user nixbot1863gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'1864gitlab # [ 199.477302] nixbot[2605]: INFO: ::ffff:127.0.0.1:56362 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK1865gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.04 seconds)1866gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'1867gitlab # [ 200.515284] nixbot[2605]: INFO: ::ffff:127.0.0.1:56374 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK1868gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.04 seconds)1869gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'1870gitlab # [ 201.550244] nixbot[2605]: INFO: ::ffff:127.0.0.1:56384 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK1871gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.04 seconds)1872gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'1873gitlab # [ 202.587321] nixbot[2605]: INFO: ::ffff:127.0.0.1:56390 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK1874gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.04 seconds)1875gitlab # [ 202.793449] nix-daemon[2824]: accepted connection from pid 2882, user nixbot1876gitlab # [ 202.807772] gitaly[920]: time="2026-08-20T08:52:34.096Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YG46S4QAD70TQGVYY5WZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:53:04.094" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:52:34.095" grpc.time_ms=0.776 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1877gitlab # [ 202.916105] gitaly[920]: time="2026-08-20T08:52:34.204Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0F5YG46S4QAD70TQGVYY5WZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:52:44.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:52:34.194" grpc.time_ms=10.432 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1878gitlab # [ 202.999678] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:52:34 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/9494aaa3888aca4a4baa3113363b88e142f740a7 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 2331879gitlab # [ 203.005341] nixbot[2605]: {"ts": "2026-08-20T08:52:34.288Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/9494aaa3888aca4a4baa3113363b88e142f740a7 \"HTTP/1.1 201 Created\""}1880gitlab # [ 203.045630] gitaly[920]: time="2026-08-20T08:52:34.334Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YGBK73QM94HPKR0A8S2K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:53:04.332" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:52:34.333" grpc.time_ms=1.052 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1881gitlab # [ 203.082442] gitaly[920]: time="2026-08-20T08:52:34.371Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0F5YGBK73QM94HPKR0A8S2K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:52:44.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:52:34.363" grpc.time_ms=7.968 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1882gitlab # [ 203.138158] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:52:34 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/9494aaa3888aca4a4baa3113363b88e142f740a7 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1351883gitlab # [ 203.143547] nixbot[2605]: {"ts": "2026-08-20T08:52:34.427Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/9494aaa3888aca4a4baa3113363b88e142f740a7 \"HTTP/1.1 201 Created\""}1884gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'1885gitlab # [ 203.626217] nixbot[2605]: INFO: ::ffff:127.0.0.1:36412 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK1886gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.04 seconds)1887gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'1888gitlab # [ 204.662473] nixbot[2605]: INFO: ::ffff:127.0.0.1:36414 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK1889gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.04 seconds)1890gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'1891gitlab # [ 205.699527] nixbot[2605]: INFO: ::ffff:127.0.0.1:36426 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK1892gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.04 seconds)1893gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'1894gitlab # [ 206.735481] nixbot[2605]: INFO: ::ffff:127.0.0.1:36432 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK1895gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.04 seconds)1896gitlab # [ 207.301438] nix-daemon[2824]: accepted connection from pid 2924, user nixbot1897gitlab # [ 207.382287] gitaly[920]: time="2026-08-20T08:52:38.670Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YMJZYRS44PE3N51WYWCF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:53:08.369" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:52:38.669" grpc.time_ms=0.848 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1898gitlab # [ 207.457713] gitaly[920]: time="2026-08-20T08:52:38.746Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0F5YMJZYRS44PE3N51WYWCF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:52:48.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:52:38.734" grpc.time_ms=11.701 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1899gitlab # [ 207.512367] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:52:38 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/9494aaa3888aca4a4baa3113363b88e142f740a7 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1761900gitlab # [ 207.513551] nixbot[2605]: {"ts": "2026-08-20T08:52:38.802Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/9494aaa3888aca4a4baa3113363b88e142f740a7 \"HTTP/1.1 201 Created\""}1901gitlab # [ 207.595782] nix-daemon[2824]: accepted connection from pid 2938, user nixbot1902gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'1903gitlab # [ 207.722317] gitaly[920]: time="2026-08-20T08:52:39.011Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F5YMWQ5CNFR4H2VWVFTQKK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:52:38.999" grpc.time_ms=11.603 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc1904gitlab # [ 207.746264] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:52:39 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 991905gitlab # [ 207.782923] nixbot[2605]: INFO: ::ffff:127.0.0.1:36446 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK1906gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.05 seconds)1907gitlab # [ 207.826237] gitaly[920]: time="2026-08-20T08:52:39.115Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YN04PACP16K873W20HW9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:52:39.102" pid=920 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1908gitlab # [ 207.846560] gitaly[920]: time="2026-08-20T08:52:39.115Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YN04PACP16K873W20HW9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:52:39.102" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc1909gitlab # [ 207.869463] gitaly[920]: time="2026-08-20T08:52:39.158Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YN04PACP16K873W20HW9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:52:39.102" grpc.time_ms=55.525 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc1910gitlab # [ 207.881474] gitlab-workhorse[824]: time="2026-08-20T08:52:39Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671911gitlab # [ 207.882493] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:52:39 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1261912gitlab # [ 207.962943] nix-daemon[2824]: accepted connection from pid 2966, user nixbot1913gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'1914gitlab # [ 208.823057] nixbot[2605]: INFO: ::ffff:127.0.0.1:36456 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK1915gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.04 seconds)1916gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'1917gitlab # [ 209.858060] nixbot[2605]: INFO: ::ffff:127.0.0.1:36470 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK1918gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.04 seconds)1919gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'1920gitlab # [ 210.894712] nixbot[2605]: INFO: ::ffff:127.0.0.1:36472 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK1921gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.04 seconds)1922gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'1923gitlab # [ 211.930994] nixbot[2605]: INFO: ::ffff:127.0.0.1:36488 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK1924gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.04 seconds)1925gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'1926gitlab # [ 212.967215] nixbot[2605]: INFO: ::ffff:127.0.0.1:36490 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK1927gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.04 seconds)1928gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'1929gitlab # [ 214.003776] nixbot[2605]: INFO: ::ffff:127.0.0.1:49766 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK1930gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.04 seconds)1931gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'1932gitlab # [ 215.040568] nixbot[2605]: INFO: ::ffff:127.0.0.1:49776 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK1933gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.04 seconds)1934gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'1935gitlab # [ 216.076719] nixbot[2605]: INFO: ::ffff:127.0.0.1:49792 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK1936gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.03 seconds)1937gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'1938gitlab # [ 217.111968] nixbot[2605]: INFO: ::ffff:127.0.0.1:49806 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK1939gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.04 seconds)1940gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'1941gitlab # [ 218.148673] nixbot[2605]: INFO: ::ffff:127.0.0.1:49812 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK1942gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.04 seconds)1943gitlab # [ 218.343084] sidekiq-cluster[2557]: 2026-08-20T08:52:49.631Z pid=2557 tid=xud INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2557, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>433504256}1944gitlab # [ 218.512629] sidekiq-cluster[2557]: W, [2026-08-20T08:52:49.801468 #2557] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1945gitlab # [ 218.549193] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:52:49.838Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1946gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'1947gitlab # [ 219.186614] nixbot[2605]: INFO: ::ffff:127.0.0.1:49826 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK1948gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.04 seconds)1949gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'1950gitlab # [ 220.210960] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:52:51.499Z","message":"GitLab reliable fetch activated!"}1951gitlab # [ 220.212146] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:52:51.499Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1952gitlab # [ 220.220795] nixbot[2605]: INFO: ::ffff:127.0.0.1:49832 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK1953gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.03 seconds)1954gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'1955gitlab # [ 221.248325] nixbot[2605]: INFO: ::ffff:127.0.0.1:49846 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK1956gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.03 seconds)1957gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'1958gitlab # [ 222.285308] nixbot[2605]: INFO: ::ffff:127.0.0.1:49858 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK1959gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.04 seconds)1960gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'1961gitlab # [ 223.323175] nixbot[2605]: INFO: ::ffff:127.0.0.1:58098 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK1962gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.04 seconds)1963gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'1964gitlab # [ 224.359357] nixbot[2605]: INFO: ::ffff:127.0.0.1:58106 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK1965gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.03 seconds)1966gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'1967gitlab # [ 225.394088] nixbot[2605]: INFO: ::ffff:127.0.0.1:58108 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK1968gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.04 seconds)1969gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'1970gitlab # [ 226.430211] nixbot[2605]: INFO: ::ffff:127.0.0.1:58120 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK1971gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.03 seconds)1972gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'1973gitlab # [ 227.465066] nixbot[2605]: INFO: ::ffff:127.0.0.1:58136 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK1974gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.03 seconds)1975gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'1976gitlab # [ 228.499311] nixbot[2605]: INFO: ::ffff:127.0.0.1:58142 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK1977gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.03 seconds)1978gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'1979gitlab # [ 229.534086] nixbot[2605]: INFO: ::ffff:127.0.0.1:58154 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK1980gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.04 seconds)1981gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'1982gitlab # [ 230.570260] nixbot[2605]: INFO: ::ffff:127.0.0.1:58170 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK1983gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.03 seconds)1984gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'1985gitlab # [ 231.606554] nixbot[2605]: INFO: ::ffff:127.0.0.1:58182 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK1986gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.03 seconds)1987gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'1988gitlab # [ 232.638981] nixbot[2605]: INFO: ::ffff:127.0.0.1:58188 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK1989gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.03 seconds)1990gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'1991gitlab # [ 233.671685] nixbot[2605]: INFO: ::ffff:127.0.0.1:49598 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK1992gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.03 seconds)1993gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'1994gitlab # [ 234.704879] nixbot[2605]: INFO: ::ffff:127.0.0.1:49600 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK1995gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.04 seconds)1996gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'1997gitlab # [ 235.741130] nixbot[2605]: INFO: ::ffff:127.0.0.1:49616 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK1998gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.03 seconds)1999gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'2000gitlab # [ 236.776543] nixbot[2605]: INFO: ::ffff:127.0.0.1:49618 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK2001gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.03 seconds)2002gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'2003gitlab # [ 237.811420] nixbot[2605]: INFO: ::ffff:127.0.0.1:49630 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK2004gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.03 seconds)2005gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'2006gitlab # [ 238.837483] nixbot[2605]: INFO: ::ffff:127.0.0.1:49642 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK2007gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.02 seconds)2008gitlab # [ 239.236786] postgres[3079]: [3079] ERROR: relation "table_without_models" does not exist2009gitlab # [ 239.237428] postgres[3079]: [3079] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')2010gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'2011gitlab # [ 239.871145] nixbot[2605]: INFO: ::ffff:127.0.0.1:49656 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK2012gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.03 seconds)2013gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'2014gitlab # [ 240.906138] nixbot[2605]: INFO: ::ffff:127.0.0.1:49658 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK2015gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.03 seconds)2016gitlab # [ 241.651867] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:12.940Z","message":"Booted Rails 7.2.3.1 application in production environment"}2017gitlab # [ 241.652984] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:12.940Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}2018gitlab # [ 241.653928] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:12.940Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}2019gitlab # [ 241.655057] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:12.940Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}2020gitlab # [ 241.655780] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:12.943Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2021gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'2022gitlab # [ 241.941264] nixbot[2605]: INFO: ::ffff:127.0.0.1:49672 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK2023gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.04 seconds)2024gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'2025gitlab # [ 242.977216] nixbot[2605]: INFO: ::ffff:127.0.0.1:49686 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK2026gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.04 seconds)2027gitlab # [ 243.020271] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:14.308Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"05a1cda746d66551a3e266d1","created_at":"2026-08-20T08:52:22.799Z","trace_propagation_headers":{"sentry-trace":"d5414f953b114d01a8177877fe6663d6-5e8c40ec89b54906","baggage":"sentry-trace_id=d5414f953b114d01a8177877fe6663d6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F5Y3VM7J75GQ2J8A1CNFGN","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:22.836Z","job_size_bytes":2,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-05a1cda746d66551a3e266d1: start","job_status":"start","queue_duration_s":51.471393,"scheduling_latency_s":51.471471}2028gitlab # [ 243.242588] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:14.531Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"05a1cda746d66551a3e266d1","created_at":"2026-08-20T08:52:22.799Z","trace_propagation_headers":{"sentry-trace":"d5414f953b114d01a8177877fe6663d6-5e8c40ec89b54906","baggage":"sentry-trace_id=d5414f953b114d01a8177877fe6663d6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F5Y3VM7J75GQ2J8A1CNFGN","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:22.836Z","job_size_bytes":2,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-05a1cda746d66551a3e266d1: done: 0.223203 sec","job_status":"done","queue_duration_s":51.471393,"scheduling_latency_s":51.471471,"redis_calls":25,"redis_duration_s":0.007591,"redis_read_bytes":912,"redis_write_bytes":2805,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.0046,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001725,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001266,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":11,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.082796,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.093253472,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.223203,"completed_at":"2026-08-20T08:53:14.531Z","load_balancing_strategy":"primary","db_duration_s":0.060441,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2029gitlab # [ 243.317525] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:14.606Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"58b11c22f6bde731ade5fe62","created_at":"2026-08-20T08:52:22.845Z","trace_propagation_headers":{"sentry-trace":"d5414f953b114d01a8177877fe6663d6-5e8c40ec89b54906","baggage":"sentry-trace_id=d5414f953b114d01a8177877fe6663d6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F5Y3VM7J75GQ2J8A1CNFGN","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:22.849Z","job_size_bytes":2,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-58b11c22f6bde731ade5fe62: start","job_status":"start","queue_duration_s":51.756726,"scheduling_latency_s":51.756785}2030gitlab # [ 243.408924] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:14.697Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"58b11c22f6bde731ade5fe62","created_at":"2026-08-20T08:52:22.845Z","trace_propagation_headers":{"sentry-trace":"d5414f953b114d01a8177877fe6663d6-5e8c40ec89b54906","baggage":"sentry-trace_id=d5414f953b114d01a8177877fe6663d6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F5Y3VM7J75GQ2J8A1CNFGN","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:22.849Z","job_size_bytes":2,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-58b11c22f6bde731ade5fe62: done: 0.091557 sec","job_status":"done","queue_duration_s":51.756726,"scheduling_latency_s":51.756785,"redis_calls":14,"redis_duration_s":0.003102,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000653,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001435,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001014,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.060389,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.07243658,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.091557,"completed_at":"2026-08-20T08:53:14.697Z","load_balancing_strategy":"primary","db_duration_s":0.023482,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2031gitlab # [ 243.481366] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:14.770Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"44605eb1acc68f0554dd59ad","created_at":"2026-08-20T08:52:23.333Z","trace_propagation_headers":{"sentry-trace":"d5414f953b114d01a8177877fe6663d6-5e8c40ec89b54906","baggage":"sentry-trace_id=d5414f953b114d01a8177877fe6663d6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F5Y3VM7J75GQ2J8A1CNFGN","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:23.338Z","job_size_bytes":5,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-44605eb1acc68f0554dd59ad: start","job_status":"start","queue_duration_s":51.430991,"scheduling_latency_s":51.431024}2032gitlab # [ 243.609581] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:14.898Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"44605eb1acc68f0554dd59ad","created_at":"2026-08-20T08:52:23.333Z","trace_propagation_headers":{"sentry-trace":"d5414f953b114d01a8177877fe6663d6-5e8c40ec89b54906","baggage":"sentry-trace_id=d5414f953b114d01a8177877fe6663d6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F5Y3VM7J75GQ2J8A1CNFGN","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:23.338Z","job_size_bytes":5,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-44605eb1acc68f0554dd59ad: done: 0.128422 sec","job_status":"done","queue_duration_s":51.430991,"scheduling_latency_s":51.431024,"redis_calls":12,"redis_duration_s":0.002867,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000812,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001647,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000408,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.095045,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000279365,"duration_s":0.128422,"completed_at":"2026-08-20T08:53:14.898Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025681,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2033gitlab # [ 243.612419] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:14.899Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"4061b8713c67ac605bb0d0d5","created_at":"2026-08-20T08:52:23.360Z","trace_propagation_headers":{"sentry-trace":"d5414f953b114d01a8177877fe6663d6-5e8c40ec89b54906","baggage":"sentry-trace_id=d5414f953b114d01a8177877fe6663d6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F5Y3VM7J75GQ2J8A1CNFGN","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:23.363Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-4061b8713c67ac605bb0d0d5: start","job_status":"start","queue_duration_s":51.53603,"scheduling_latency_s":51.536045}2034gitlab # [ 243.871228] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:15.159Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"4061b8713c67ac605bb0d0d5","created_at":"2026-08-20T08:52:23.360Z","trace_propagation_headers":{"sentry-trace":"d5414f953b114d01a8177877fe6663d6-5e8c40ec89b54906","baggage":"sentry-trace_id=d5414f953b114d01a8177877fe6663d6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F5Y3VM7J75GQ2J8A1CNFGN","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:23.363Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-4061b8713c67ac605bb0d0d5: done: 0.260079 sec","job_status":"done","queue_duration_s":51.53603,"scheduling_latency_s":51.536045,"redis_calls":11,"redis_duration_s":0.002641,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00083,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001407,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000404,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.104,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.147,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.147,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.104,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.111257,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000309257,"duration_s":0.260079,"completed_at":"2026-08-20T08:53:15.159Z","load_balancing_strategy":"primary","db_duration_s":0.149344,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2035gitlab # [ 243.873522] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:15.161Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"97574839aed40525be640936","created_at":"2026-08-20T08:52:23.365Z","trace_propagation_headers":{"sentry-trace":"d5414f953b114d01a8177877fe6663d6-5e8c40ec89b54906","baggage":"sentry-trace_id=d5414f953b114d01a8177877fe6663d6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F5Y3VM7J75GQ2J8A1CNFGN","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:23.368Z","job_size_bytes":89,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-97574839aed40525be640936: start","job_status":"start","queue_duration_s":51.792284,"scheduling_latency_s":51.792323}2036gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'2037gitlab # [ 243.948219] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:15.187Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"97574839aed40525be640936","created_at":"2026-08-20T08:52:23.365Z","trace_propagation_headers":{"sentry-trace":"d5414f953b114d01a8177877fe6663d6-5e8c40ec89b54906","baggage":"sentry-trace_id=d5414f953b114d01a8177877fe6663d6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F5Y3VM7J75GQ2J8A1CNFGN","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:23.368Z","job_size_bytes":89,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-97574839aed40525be640936: done: 0.026242 sec","job_status":"done","queue_duration_s":51.792284,"scheduling_latency_s":51.792323,"redis_calls":11,"redis_duration_s":0.0021650000000000003,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000616,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001144,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000405,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015122,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000279365,"duration_s":0.026242,"completed_at":"2026-08-20T08:53:15.187Z","load_balancing_strategy":"primary","db_duration_s":0.005397,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2038gitlab # [ 243.984713] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:15.188Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 9494aaa3888aca4a4baa3113363b88e142f740a7 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"0de903085b1c24b9812c2886","created_at":"2026-08-20T08:52:24.793Z","trace_propagation_headers":{"sentry-trace":"3df3413170b44608bc071f60319e9391-04dd0c4f1da84db1","baggage":"sentry-trace_id=3df3413170b44608bc071f60319e9391,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F5Y6KE3JCH97SB8C2E4C9N","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:24.797Z","job_size_bytes":185,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-0de903085b1c24b9812c2886: start","job_status":"start","queue_duration_s":50.391289,"scheduling_latency_s":50.391302}2039gitlab # [ 243.985199] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:15.199Z","message":"changes: \"0000000000000000000000000000000000000000 9494aaa3888aca4a4baa3113363b88e142f740a7 refs/heads/master\\n\""}2040gitlab # [ 243.986831] gitaly[920]: time="2026-08-20T08:53:15.231Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:53:25.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:53:15.222" grpc.time_ms=9.226 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2041gitlab # [ 243.987712] gitaly[920]: time="2026-08-20T08:53:15.244Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T08:53:25.015" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:53:15.235" grpc.time_ms=9 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2042gitlab # [ 244.007232] gitaly[920]: time="2026-08-20T08:53:15.296Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-20T08:53:25.059" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:53:15.279" grpc.time_ms=16.181 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2043gitlab # [ 244.059153] gitaly[920]: time="2026-08-20T08:53:15.347Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3931 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:53:15.346" grpc.time_ms=0.372 pid=920 span.kind=server system=grpc2044gitlab # [ 244.071139] nixbot[2605]: INFO: ::ffff:127.0.0.1:41218 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK2045gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.09 seconds)2046gitlab # [ 244.087607] gitaly[920]: time="2026-08-20T08:53:15.376Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3933 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:53:15.376" grpc.time_ms=0.297 pid=920 span.kind=server system=grpc2047gitlab # [ 244.104788] gitaly[920]: time="2026-08-20T08:53:15.393Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N diskcache=7f739e98-8c4a-4324-9a1a-1ddc4b2e50ce grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T08:53:25.092" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:53:15.312" pid=920 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2048gitlab # [ 244.105665] gitaly[920]: time="2026-08-20T08:53:15.394Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=63 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5163 command.oublock=8 command.real_time_ms=73 command.spawn_token_fork_ms=1 command.system_time_ms=43 command.user_time_ms=20 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T08:53:25.092" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:53:15.312" grpc.time_ms=80.98 pid=920 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2049gitlab # [ 244.120063] gitaly[920]: time="2026-08-20T08:53:15.409Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:53:25.188" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:53:15.408" grpc.time_ms=0.147 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2050gitlab # [ 244.142574] gitaly[920]: time="2026-08-20T08:53:15.431Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=937 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-20T08:53:25.203" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:53:15.423" grpc.time_ms=8.032 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2051gitlab # [ 244.203730] gitaly[920]: time="2026-08-20T08:53:15.492Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=341 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-20T08:53:45.087" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:53:15.488" grpc.time_ms=4.593 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2052gitlab # [ 244.224599] gitaly[920]: time="2026-08-20T08:53:15.513Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T08:53:25.292" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:53:15.513" grpc.time_ms=0.163 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2053gitlab # [ 244.240075] gitaly[920]: time="2026-08-20T08:53:15.529Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=342 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-20T08:53:25.302" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-20T08:53:15.522" grpc.time_ms=6.242 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2054gitlab # [ 244.259116] gitaly[920]: time="2026-08-20T08:53:15.548Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:53:25.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:53:15.538" grpc.time_ms=9.809 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2055gitlab # [ 244.271137] gitaly[920]: time="2026-08-20T08:53:15.560Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:53:25.021" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:53:15.552" grpc.time_ms=8.082 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2056gitlab # [ 244.296709] gitaly[920]: time="2026-08-20T08:53:15.585Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=964 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T08:53:45.174" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:53:15.575" grpc.time_ms=10.516 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2057gitlab # [ 244.675812] gitaly[920]: time="2026-08-20T08:53:15.964Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-20T08:53:25.003" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:53:15.964" grpc.time_ms=0.737 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2058gitlab # [ 244.717446] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:16.005Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 9494aaa3888aca4a4baa3113363b88e142f740a7 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"0de903085b1c24b9812c2886","created_at":"2026-08-20T08:52:24.793Z","trace_propagation_headers":{"sentry-trace":"3df3413170b44608bc071f60319e9391-04dd0c4f1da84db1","baggage":"sentry-trace_id=3df3413170b44608bc071f60319e9391,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F5Y6KE3JCH97SB8C2E4C9N","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:24.797Z","job_size_bytes":185,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-0de903085b1c24b9812c2886: done: 0.816915 sec","job_status":"done","queue_duration_s":50.391289,"scheduling_latency_s":50.391302,"gitaly_calls":13,"gitaly_duration_s":0.229656,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.040025,"redis_read_bytes":2103,"redis_write_bytes":21749,"redis_cache_calls":15,"redis_cache_duration_s":0.003154,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.005967,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001434,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7837,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002848,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.01529,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.011332,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.053,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.169,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.189,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.053,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.475666,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000407315,"exclusive_lock_hold_duration_s":0.025996321,"duration_s":0.816915,"completed_at":"2026-08-20T08:53:16.005Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.092946,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2059gitlab # [ 244.723883] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:16.007Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","9494aaa3888aca4a4baa3113363b88e142f740a7 361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"de197ef54ecf43e6358e08ca","created_at":"2026-08-20T08:52:28.553Z","trace_propagation_headers":{"sentry-trace":"df45df268ba94c4882b68afc416d3d49-fbacf812132f4d38","baggage":"sentry-trace_id=df45df268ba94c4882b68afc416d3d49,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F5YABGHEET032Y6TE1W821","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:28.556Z","job_size_bytes":185,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-de197ef54ecf43e6358e08ca: start","job_status":"start","queue_duration_s":47.451305,"scheduling_latency_s":47.451336}2060gitlab # [ 244.787649] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:16.076Z","message":"changes: \"9494aaa3888aca4a4baa3113363b88e142f740a7 361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 refs/heads/master\\n\""}2061gitlab # [ 244.822093] gitaly[920]: time="2026-08-20T08:53:16.111Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0F5YABGHEET032Y6TE1W821 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:53:26.000" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:53:16.101" grpc.time_ms=9.661 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2062gitlab # [ 244.847405] gitaly[920]: time="2026-08-20T08:53:16.136Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YABGHEET032Y6TE1W821 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T08:53:26.025" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:53:16.125" grpc.time_ms=10.521 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2063gitlab # [ 244.858433] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:16.141Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"c1cf9e903cd9ffa5a7d52b99","created_at":"2026-08-20T08:53:16.139Z","trace_propagation_headers":{"sentry-trace":"df45df268ba94c4882b68afc416d3d49-38991dfec95b43ae","baggage":"sentry-trace_id=df45df268ba94c4882b68afc416d3d49,sentry-release=Unknown"},"correlation_id":"01M0F5YABGHEET032Y6TE1W821","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"cac674b5e74c32215d4ce031","job_size_bytes":46,"pid":2557,"job_status":"deduplicated","message":"ProjectCacheWorker JID-c1cf9e903cd9ffa5a7d52b99: deduplicated: until executing","deduplication.type":"until executing"}2064gitlab # [ 244.888412] gitaly[920]: time="2026-08-20T08:53:16.177Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F5YABGHEET032Y6TE1W821 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-20T08:53:26.065" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:53:16.166" grpc.time_ms=11.231 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2065gitlab # [ 244.904173] gitaly[920]: time="2026-08-20T08:53:16.193Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=654 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0F5YABGHEET032Y6TE1W821 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-20T08:53:46.082" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:53:16.182" grpc.time_ms=10.133 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2066gitlab # [ 244.921795] gitaly[920]: time="2026-08-20T08:53:16.210Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=345 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F5YABGHEET032Y6TE1W821 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-20T08:53:26.103" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-20T08:53:16.204" grpc.time_ms=6.468 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2067gitlab # [ 244.943727] gitaly[920]: time="2026-08-20T08:53:16.232Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F5YABGHEET032Y6TE1W821 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:53:26.122" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:53:16.223" grpc.time_ms=9.421 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2068gitlab # [ 245.017746] gitaly[920]: time="2026-08-20T08:53:16.306Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F5YABGHEET032Y6TE1W821 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-20T08:53:26.204" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:53:16.304" grpc.time_ms=1.108 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2069gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'2070gitlab # [ 245.030131] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:16.318Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","9494aaa3888aca4a4baa3113363b88e142f740a7 361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"de197ef54ecf43e6358e08ca","created_at":"2026-08-20T08:52:28.553Z","trace_propagation_headers":{"sentry-trace":"df45df268ba94c4882b68afc416d3d49-fbacf812132f4d38","baggage":"sentry-trace_id=df45df268ba94c4882b68afc416d3d49,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F5YABGHEET032Y6TE1W821","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:52:28.556Z","job_size_bytes":185,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-de197ef54ecf43e6358e08ca: done: 0.311444 sec","job_status":"done","queue_duration_s":47.451305,"scheduling_latency_s":47.451336,"gitaly_calls":7,"gitaly_duration_s":0.076736,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.04228,"redis_read_bytes":500,"redis_write_bytes":11940,"redis_cache_calls":9,"redis_cache_duration_s":0.002663,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.000913,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5717,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.013224,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.016943,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.008537,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.022,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.022,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.131726,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000678298,"exclusive_lock_hold_duration_s":0.03048488,"duration_s":0.311444,"completed_at":"2026-08-20T08:53:16.318Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027095,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2071gitlab # [ 245.081394] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:16.320Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"24667e3696901499aeebfaba","created_at":"2026-08-20T08:52:29.450Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-2f86f3f59cb54b15","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:29.458Z","job_size_bytes":65,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-24667e3696901499aeebfaba: start","job_status":"start","queue_duration_s":46.8614,"scheduling_latency_s":46.861417}2072gitlab # [ 245.117741] nixbot[2605]: INFO: ::ffff:127.0.0.1:41222 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK2073gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.04 seconds)2074gitlab # [ 245.153683] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:16.442Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"24667e3696901499aeebfaba","created_at":"2026-08-20T08:52:29.450Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-2f86f3f59cb54b15","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:29.458Z","job_size_bytes":65,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-24667e3696901499aeebfaba: done: 0.122358 sec","job_status":"done","queue_duration_s":46.8614,"scheduling_latency_s":46.861417,"redis_calls":16,"redis_duration_s":0.0034159999999999998,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001741,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001302,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000373,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.092158,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000307861,"duration_s":0.122358,"completed_at":"2026-08-20T08:53:16.442Z","load_balancing_strategy":"primary","db_duration_s":0.023888,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2075gitlab # [ 245.198252] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:16.486Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"a876aee8ec5abac8229fee79","created_at":"2026-08-20T08:52:29.459Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-2f86f3f59cb54b15","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:29.464Z","job_size_bytes":65,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-a876aee8ec5abac8229fee79: start","job_status":"start","queue_duration_s":47.021969,"scheduling_latency_s":47.022002}2076gitlab # [ 245.287296] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:16.575Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"a876aee8ec5abac8229fee79","created_at":"2026-08-20T08:52:29.459Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-2f86f3f59cb54b15","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:29.464Z","job_size_bytes":65,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-a876aee8ec5abac8229fee79: done: 0.08908 sec","job_status":"done","queue_duration_s":47.021969,"scheduling_latency_s":47.022002,"redis_calls":21,"redis_duration_s":0.005014,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.002013,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00168,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001321,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047737,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000472965,"duration_s":0.08908,"completed_at":"2026-08-20T08:53:16.575Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.029352,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2077gitlab # [ 245.289545] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:16.577Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"08843866c2ad4c761ee854a5","created_at":"2026-08-20T08:52:29.567Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-2f86f3f59cb54b15","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:29.571Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-08843866c2ad4c761ee854a5: start","job_status":"start","queue_duration_s":47.005971,"scheduling_latency_s":47.006003}2078gitlab # [ 245.450749] gitaly[920]: time="2026-08-20T08:53:16.739Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F5YB7EGS4WK7HWWG5MRVQC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:53:16.739" grpc.time_ms=0.517 pid=920 span.kind=server system=grpc2079gitlab # [ 245.503631] gitaly[920]: time="2026-08-20T08:53:16.792Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F5YB7EGS4WK7HWWG5MRVQC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3890 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:53:16.791" grpc.time_ms=1.251 pid=920 span.kind=server system=grpc2080gitlab # [ 245.557301] gitaly[920]: time="2026-08-20T08:53:16.846Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F5YB7EGS4WK7HWWG5MRVQC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:53:16.845" grpc.time_ms=0.564 pid=920 span.kind=server system=grpc2081gitlab # [ 245.580654] gitaly[920]: time="2026-08-20T08:53:16.869Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YB7EGS4WK7HWWG5MRVQC diskcache=391320c2-da2a-4cc1-9ec2-fcd0760b75e3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T08:53:46.602" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:53:16.703" pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2082gitlab # [ 245.581637] gitaly[920]: time="2026-08-20T08:53:16.870Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=190 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7504 command.oublock=0 command.real_time_ms=159 command.spawn_token_fork_ms=0 command.system_time_ms=129 command.user_time_ms=61 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YB7EGS4WK7HWWG5MRVQC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T08:53:46.602" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:53:16.703" grpc.time_ms=166.85 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2083gitlab # [ 245.686414] gitaly[920]: time="2026-08-20T08:53:16.975Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F5YB7EGS4WK7HWWG5MRVQC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T08:53:46.873" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:53:16.974" grpc.time_ms=0.952 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2084gitlab # [ 245.714273] gitaly[920]: time="2026-08-20T08:53:17.003Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YB7EGS4WK7HWWG5MRVQC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:53:47.001" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:53:17.002" grpc.time_ms=0.695 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2085gitlab # [ 245.746723] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:17.034Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"08843866c2ad4c761ee854a5","created_at":"2026-08-20T08:52:29.567Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-2f86f3f59cb54b15","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:29.571Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2557,"job_status":"rescheduled","message":"PipelineProcessWorker JID-08843866c2ad4c761ee854a5: rescheduled"}2086gitlab # [ 245.752685] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:17.041Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"08843866c2ad4c761ee854a5","created_at":"2026-08-20T08:52:29.567Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-2f86f3f59cb54b15","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T08:52:29.571Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-08843866c2ad4c761ee854a5: done: 0.463675 sec","job_status":"done","queue_duration_s":47.005971,"scheduling_latency_s":47.006003,"gitaly_calls":3,"gitaly_duration_s":0.198131,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.026271000000000003,"redis_read_bytes":462,"redis_write_bytes":29289,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000998,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001272,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.009889,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.004094,"redis_queues_read_bytes":39,"redis_queues_write_bytes":15576,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.006074,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000507,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000429,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00201,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.056,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.017,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.021,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.029,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.19953,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.400746185,"duration_s":0.463675,"completed_at":"2026-08-20T08:53:17.041Z","load_balancing_strategy":"primary","db_duration_s":0.067297,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2087gitlab # [ 245.799530] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:17.042Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"cac674b5e74c32215d4ce031","created_at":"2026-08-20T08:53:15.246Z","trace_propagation_headers":{"sentry-trace":"3df3413170b44608bc071f60319e9391-e790be5d344748c4","baggage":"sentry-trace_id=3df3413170b44608bc071f60319e9391,sentry-release=Unknown"},"correlation_id":"01M0F5Y6KE3JCH97SB8C2E4C9N","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:15.259Z","job_size_bytes":46,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-cac674b5e74c32215d4ce031: start","job_status":"start","queue_duration_s":1.783669,"scheduling_latency_s":1.783685}2088gitlab # [ 245.800332] gitaly[920]: time="2026-08-20T08:53:17.078Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-20T14:53:17.072" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:53:17.072" grpc.time_ms=4.916 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2089gitlab # [ 245.806647] gitaly[920]: time="2026-08-20T08:53:17.095Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=651 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-20T08:53:47.089" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:53:17.089" grpc.time_ms=6.011 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2090gitlab # [ 245.836578] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:17.125Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"cac674b5e74c32215d4ce031","created_at":"2026-08-20T08:53:15.246Z","trace_propagation_headers":{"sentry-trace":"3df3413170b44608bc071f60319e9391-e790be5d344748c4","baggage":"sentry-trace_id=3df3413170b44608bc071f60319e9391,sentry-release=Unknown"},"correlation_id":"01M0F5Y6KE3JCH97SB8C2E4C9N","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:15.259Z","job_size_bytes":46,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-cac674b5e74c32215d4ce031: done: 0.082309 sec","job_status":"done","queue_duration_s":1.783669,"scheduling_latency_s":1.783685,"gitaly_calls":2,"gitaly_duration_s":0.015839,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.006081,"redis_read_bytes":69,"redis_write_bytes":4888,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.00119,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.00046,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001322,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.002538,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000571,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049501,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000348089,"duration_s":0.082309,"completed_at":"2026-08-20T08:53:17.125Z","load_balancing_strategy":"primary","db_duration_s":0.011172,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2091gitlab # [ 245.849329] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:17.126Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"468771ed6165942b27c22e20","created_at":"2026-08-20T08:53:15.271Z","trace_propagation_headers":{"sentry-trace":"3df3413170b44608bc071f60319e9391-e790be5d344748c4","baggage":"sentry-trace_id=3df3413170b44608bc071f60319e9391,sentry-release=Unknown"},"correlation_id":"01M0F5Y6KE3JCH97SB8C2E4C9N","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:15.276Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-468771ed6165942b27c22e20: start","job_status":"start","queue_duration_s":1.850074,"scheduling_latency_s":1.8501}2092gitlab # [ 245.892177] gitaly[920]: time="2026-08-20T08:53:17.164Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N diskcache=dae4119c-3dd9-4289-86f9-10452e9eec6b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T14:53:17.141" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:53:17.141" pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2093gitlab # [ 245.893060] gitaly[920]: time="2026-08-20T08:53:17.164Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1284 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T14:53:17.141" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:53:17.141" grpc.time_ms=22.507 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2094gitlab # [ 245.898470] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:17.187Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"468771ed6165942b27c22e20","created_at":"2026-08-20T08:53:15.271Z","trace_propagation_headers":{"sentry-trace":"3df3413170b44608bc071f60319e9391-e790be5d344748c4","baggage":"sentry-trace_id=3df3413170b44608bc071f60319e9391,sentry-release=Unknown"},"correlation_id":"01M0F5Y6KE3JCH97SB8C2E4C9N","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:15.276Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-468771ed6165942b27c22e20: done: 0.060616 sec","job_status":"done","queue_duration_s":1.850074,"scheduling_latency_s":1.8501,"gitaly_calls":1,"gitaly_duration_s":0.024247,"redis_calls":15,"redis_duration_s":0.00198,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000253,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000722,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000355,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00065,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.012,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022925,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.044987561999999995,"duration_s":0.060616,"completed_at":"2026-08-20T08:53:17.187Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008923,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2095gitlab # [ 245.941932] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:17.188Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"1c390914b9e28b3b493ff08f","created_at":"2026-08-20T08:53:15.405Z","trace_propagation_headers":{"sentry-trace":"3df3413170b44608bc071f60319e9391-e790be5d344748c4","baggage":"sentry-trace_id=3df3413170b44608bc071f60319e9391,sentry-release=Unknown"},"correlation_id":"01M0F5Y6KE3JCH97SB8C2E4C9N","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:15.407Z","job_size_bytes":23,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-1c390914b9e28b3b493ff08f: start","job_status":"start","queue_duration_s":1.781232,"scheduling_latency_s":1.781246}2096gitlab # [ 245.942824] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:17.215Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"1c390914b9e28b3b493ff08f","created_at":"2026-08-20T08:53:15.405Z","trace_propagation_headers":{"sentry-trace":"3df3413170b44608bc071f60319e9391-e790be5d344748c4","baggage":"sentry-trace_id=3df3413170b44608bc071f60319e9391,sentry-release=Unknown"},"correlation_id":"01M0F5Y6KE3JCH97SB8C2E4C9N","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:15.407Z","job_size_bytes":23,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-1c390914b9e28b3b493ff08f: done: 0.02703 sec","job_status":"done","queue_duration_s":1.781232,"scheduling_latency_s":1.781246,"gitaly_calls":1,"gitaly_duration_s":0.007549,"redis_calls":16,"redis_duration_s":0.002093,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000173,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000659,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.000862,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000399,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015442,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02703,"completed_at":"2026-08-20T08:53:17.215Z","load_balancing_strategy":"primary","db_duration_s":0.001517,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2097gitlab # [ 245.985487] gitaly[920]: time="2026-08-20T08:53:17.209Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=649 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-20T08:53:47.103" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:53:17.204" grpc.time_ms=5.706 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2098gitlab # [ 245.986303] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:17.216Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"af704637b1a7db9e721d304c","created_at":"2026-08-20T08:53:15.822Z","trace_propagation_headers":{"sentry-trace":"3df3413170b44608bc071f60319e9391-e790be5d344748c4","baggage":"sentry-trace_id=3df3413170b44608bc071f60319e9391,sentry-release=Unknown"},"correlation_id":"01M0F5Y6KE3JCH97SB8C2E4C9N","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:93dfc89b07db0bdd101edfc5331e0bf9214f324186784a960c91a10db60e8efc","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:15.828Z","job_size_bytes":467,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-af704637b1a7db9e721d304c: start","job_status":"start","queue_duration_s":1.387858,"scheduling_latency_s":1.387872}2099gitlab # [ 245.993895] gitaly[920]: time="2026-08-20T08:53:17.231Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:53:47.130" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:53:17.231" grpc.time_ms=0.373 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2100gitlab # [ 246.004761] gitaly[920]: time="2026-08-20T08:53:17.237Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T08:53:27.132" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:53:17.232" grpc.time_ms=4.962 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2101gitlab # [ 246.016307] gitaly[920]: time="2026-08-20T08:53:17.305Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T08:53:47.204" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:53:17.304" grpc.time_ms=0.68 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2102gitlab # [ 246.052979] gitaly[920]: time="2026-08-20T08:53:17.313Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=201 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-20T08:53:47.209" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:53:17.310" grpc.time_ms=2.91 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2103gitlab # [ 246.079975] gitaly[920]: time="2026-08-20T08:53:17.369Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:53:27.263" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:53:17.363" grpc.time_ms=5.692 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2104gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'2105gitlab # [ 246.164387] nixbot[2605]: INFO: ::ffff:127.0.0.1:41230 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK2106gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.05 seconds)2107gitlab # [ 246.516608] gitaly[920]: time="2026-08-20T08:53:17.805Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=967 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T08:53:47.688" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:53:17.788" grpc.time_ms=17.027 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2108gitlab # [ 246.561352] gitaly[920]: time="2026-08-20T08:53:17.850Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0F5Y6KE3JCH97SB8C2E4C9N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-20T08:53:47.735" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:53:17.836" grpc.time_ms=14.133 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2109gitlab # [ 246.599580] sidekiq-cluster[2557]: {"severity":"WARN","time":"2026-08-20T08:53:17.888Z","class":"CreatePipelineWorker","correlation_id":"01M0F5Y6KE3JCH97SB8C2E4C9N","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"9494aaa3888aca4a4baa3113363b88e142f740a7","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"9494aaa3888aca4a4baa3113363b88e142f740a7","ref":"refs/heads/master"},"retry":0}2110gitlab # [ 246.609693] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:17.898Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"af704637b1a7db9e721d304c","created_at":"2026-08-20T08:53:15.822Z","trace_propagation_headers":{"sentry-trace":"3df3413170b44608bc071f60319e9391-e790be5d344748c4","baggage":"sentry-trace_id=3df3413170b44608bc071f60319e9391,sentry-release=Unknown"},"correlation_id":"01M0F5Y6KE3JCH97SB8C2E4C9N","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:93dfc89b07db0bdd101edfc5331e0bf9214f324186784a960c91a10db60e8efc","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:15.828Z","job_size_bytes":467,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-af704637b1a7db9e721d304c: done: 0.681949 sec","job_status":"done","queue_duration_s":1.387858,"scheduling_latency_s":1.387872,"gitaly_calls":7,"gitaly_duration_s":0.099262,"redis_calls":51,"redis_duration_s":0.007496,"redis_read_bytes":169,"redis_write_bytes":4167,"redis_cache_calls":4,"redis_cache_duration_s":0.000498,"redis_cache_read_bytes":10,"redis_cache_write_bytes":342,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.003484,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00104,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.001543,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000931,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.536201,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000462908,"duration_s":0.681949,"completed_at":"2026-08-20T08:53:17.898Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.034436,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2111gitlab # [ 246.620476] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:17.900Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"23fd138a-0355-44f8-abe3-c6cc05a1b12c\"}"],"class":"WebHookWorker","jid":"cf2138f3445884228913c6cc","created_at":"2026-08-20T08:53:15.939Z","trace_propagation_headers":{"sentry-trace":"3df3413170b44608bc071f60319e9391-e790be5d344748c4","baggage":"sentry-trace_id=3df3413170b44608bc071f60319e9391,sentry-release=Unknown"},"correlation_id":"01M0F5Y6KE3JCH97SB8C2E4C9N","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d8278d355f29b7cf678ed655b782dcdc064d31158b9eb04d0ede4d208c65c5f1","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:15.944Z","job_size_bytes":1751,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-cf2138f3445884228913c6cc: start","job_status":"start","queue_duration_s":1.955407,"scheduling_latency_s":1.955435}2112gitlab # [ 246.700086] nixbot[2605]: INFO: ::ffff:127.0.0.1:41232 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2113gitlab # [ 246.714950] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:18.003Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"23fd138a-0355-44f8-abe3-c6cc05a1b12c\"}"],"class":"WebHookWorker","jid":"cf2138f3445884228913c6cc","created_at":"2026-08-20T08:53:15.939Z","trace_propagation_headers":{"sentry-trace":"3df3413170b44608bc071f60319e9391-e790be5d344748c4","baggage":"sentry-trace_id=3df3413170b44608bc071f60319e9391,sentry-release=Unknown"},"correlation_id":"01M0F5Y6KE3JCH97SB8C2E4C9N","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d8278d355f29b7cf678ed655b782dcdc064d31158b9eb04d0ede4d208c65c5f1","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:15.944Z","job_size_bytes":1751,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-cf2138f3445884228913c6cc: done: 0.10369 sec","job_status":"done","queue_duration_s":1.955407,"scheduling_latency_s":1.955435,"redis_calls":19,"redis_duration_s":0.003263,"redis_read_bytes":32,"redis_write_bytes":5368,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000754,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000346,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3730,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001424,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000739,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.030335420000000113,"cpu_s":0.061778,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000310934,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.10369,"completed_at":"2026-08-20T08:53:18.003Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002152,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2114gitlab # [ 246.755577] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:18.043Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"cc32c30d1c98607e812ab492","created_at":"2026-08-20T08:53:16.148Z","trace_propagation_headers":{"sentry-trace":"df45df268ba94c4882b68afc416d3d49-38991dfec95b43ae","baggage":"sentry-trace_id=df45df268ba94c4882b68afc416d3d49,sentry-release=Unknown"},"correlation_id":"01M0F5YABGHEET032Y6TE1W821","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"468771ed6165942b27c22e20","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:16.161Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-cc32c30d1c98607e812ab492: start","job_status":"start","queue_duration_s":1.88274,"scheduling_latency_s":1.882764}2115gitlab # [ 246.784649] gitaly[920]: time="2026-08-20T08:53:18.073Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F5ZV1P5ZT2X0TKGSKA2SPK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:53:18.066" grpc.time_ms=6.49 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc2116gitlab # [ 246.786367] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:53:18 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 672117gitlab # [ 246.802829] gitaly[920]: time="2026-08-20T08:53:18.091Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YABGHEET032Y6TE1W821 diskcache=79719c41-5eaf-45c3-8a9d-b42306ee7157 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T14:53:18.071" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:53:18.071" pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2118gitlab # [ 246.803833] gitaly[920]: time="2026-08-20T08:53:18.092Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=312 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YABGHEET032Y6TE1W821 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T14:53:18.071" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:53:18.071" grpc.time_ms=20.271 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2119gitlab # [ 246.834751] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:18.123Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"cc32c30d1c98607e812ab492","created_at":"2026-08-20T08:53:16.148Z","trace_propagation_headers":{"sentry-trace":"df45df268ba94c4882b68afc416d3d49-38991dfec95b43ae","baggage":"sentry-trace_id=df45df268ba94c4882b68afc416d3d49,sentry-release=Unknown"},"correlation_id":"01M0F5YABGHEET032Y6TE1W821","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"468771ed6165942b27c22e20","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:16.161Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-cc32c30d1c98607e812ab492: done: 0.079554 sec","job_status":"done","queue_duration_s":1.88274,"scheduling_latency_s":1.882764,"gitaly_calls":1,"gitaly_duration_s":0.040527,"redis_calls":12,"redis_duration_s":0.0017029999999999999,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000663,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000386,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000654,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018204,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.052299943,"duration_s":0.079554,"completed_at":"2026-08-20T08:53:18.123Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004824,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2120gitlab # [ 246.872187] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:18.161Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"8b4a13ecb66cbecdaef2fa75","created_at":"2026-08-20T08:53:16.284Z","trace_propagation_headers":{"sentry-trace":"df45df268ba94c4882b68afc416d3d49-38991dfec95b43ae","baggage":"sentry-trace_id=df45df268ba94c4882b68afc416d3d49,sentry-release=Unknown"},"correlation_id":"01M0F5YABGHEET032Y6TE1W821","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7195c0ffd9bb4e5d9201466c4f7c8748982e2977a223b07d581c80f21c27deb4","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:16.285Z","job_size_bytes":467,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-8b4a13ecb66cbecdaef2fa75: start","job_status":"start","queue_duration_s":1.875327,"scheduling_latency_s":1.875351}2121gitlab # [ 246.893805] gitaly[920]: time="2026-08-20T08:53:18.182Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YABGHEET032Y6TE1W821 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:53:48.082" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:53:18.182" grpc.time_ms=0.421 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2122gitlab # [ 246.904100] gitaly[920]: time="2026-08-20T08:53:18.190Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YABGHEET032Y6TE1W821 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T08:53:28.084" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:53:18.184" grpc.time_ms=5.699 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2123gitlab # [ 246.912456] gitaly[920]: time="2026-08-20T08:53:18.201Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5ZV3VYZTA54JT8760SZGH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:53:18.190" pid=920 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2124gitlab # [ 246.913242] gitaly[920]: time="2026-08-20T08:53:18.201Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5ZV3VYZTA54JT8760SZGH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:53:18.190" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc2125gitlab # [ 246.913980] gitlab-workhorse[824]: time="2026-08-20T08:53:18Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672126gitlab # [ 246.914651] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:53:18 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1272127gitlab # [ 246.915217] gitaly[920]: time="2026-08-20T08:53:18.201Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5ZV3VYZTA54JT8760SZGH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:53:18.190" grpc.time_ms=11.566 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc2128gitlab # [ 246.963360] nixbot[2605]: {"ts": "2026-08-20T08:53:18.252Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2129gitlab # [ 246.972356] gitaly[920]: time="2026-08-20T08:53:18.261Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F5YABGHEET032Y6TE1W821 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T08:53:48.160" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:53:18.260" grpc.time_ms=0.753 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2130gitlab # [ 246.986469] gitaly[920]: time="2026-08-20T08:53:18.275Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=44 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F5YABGHEET032Y6TE1W821 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-20T08:53:48.173" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:53:18.273" grpc.time_ms=1.546 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2131gitlab # [ 247.007654] gitaly[920]: time="2026-08-20T08:53:18.296Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F5YABGHEET032Y6TE1W821 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:53:28.190" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:53:18.291" grpc.time_ms=5.329 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2132gitlab # [ 247.021474] gitaly[920]: time="2026-08-20T08:53:18.310Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5ZV9QZE07K4RQG9FZ91GX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:53:48.009" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:53:18.309" grpc.time_ms=0.462 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2133gitlab # [ 247.083817] gitaly[920]: time="2026-08-20T08:53:18.372Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0F5ZV9QZE07K4RQG9FZ91GX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:53:28.173" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:53:18.363" grpc.time_ms=8.415 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2134gitlab # [ 247.135469] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:53:18 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/9494aaa3888aca4a4baa3113363b88e142f740a7 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 1602135gitlab # [ 247.137324] nixbot[2605]: {"ts": "2026-08-20T08:53:18.425Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/9494aaa3888aca4a4baa3113363b88e142f740a7 \"HTTP/1.1 201 Created\""}2136gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'2137gitlab # [ 247.183852] gitaly[920]: time="2026-08-20T08:53:18.472Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5ZVF3RTE1JTW4MNVP2AQ9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:53:48.171" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:53:18.472" grpc.time_ms=0.402 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2138gitlab # [ 247.200564] nixbot[2605]: INFO: ::ffff:127.0.0.1:41240 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK2139gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 0.05 seconds)2140gitlab # [ 247.249262] gitaly[920]: time="2026-08-20T08:53:18.538Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0F5ZVF3RTE1JTW4MNVP2AQ9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:53:28.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:53:18.527" grpc.time_ms=10.252 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2141gitlab # [ 247.302812] gitaly[920]: time="2026-08-20T08:53:18.591Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=962 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0F5YABGHEET032Y6TE1W821 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T08:53:48.478" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:53:18.578" grpc.time_ms=13.139 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2142gitlab # [ 247.317854] gitaly[920]: time="2026-08-20T08:53:18.606Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F5YABGHEET032Y6TE1W821 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-20T08:53:48.494" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:53:18.594" grpc.time_ms=11.033 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2143gitlab # [ 247.325215] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:53:18 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/9494aaa3888aca4a4baa3113363b88e142f740a7 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1782144gitlab # [ 247.326903] nixbot[2605]: {"ts": "2026-08-20T08:53:18.615Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/9494aaa3888aca4a4baa3113363b88e142f740a7 \"HTTP/1.1 201 Created\""}2145gitlab # [ 247.351397] sidekiq-cluster[2557]: {"severity":"WARN","time":"2026-08-20T08:53:18.640Z","class":"CreatePipelineWorker","correlation_id":"01M0F5YABGHEET032Y6TE1W821","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"9494aaa3888aca4a4baa3113363b88e142f740a7","after":"361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3","ref":"refs/heads/master"},"retry":0}2146gitlab # [ 247.360817] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:18.649Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"8b4a13ecb66cbecdaef2fa75","created_at":"2026-08-20T08:53:16.284Z","trace_propagation_headers":{"sentry-trace":"df45df268ba94c4882b68afc416d3d49-38991dfec95b43ae","baggage":"sentry-trace_id=df45df268ba94c4882b68afc416d3d49,sentry-release=Unknown"},"correlation_id":"01M0F5YABGHEET032Y6TE1W821","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7195c0ffd9bb4e5d9201466c4f7c8748982e2977a223b07d581c80f21c27deb4","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:16.285Z","job_size_bytes":467,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-8b4a13ecb66cbecdaef2fa75: done: 0.488693 sec","job_status":"done","queue_duration_s":1.875327,"scheduling_latency_s":1.875351,"gitaly_calls":7,"gitaly_duration_s":0.086664,"redis_calls":33,"redis_duration_s":0.018698,"redis_read_bytes":185,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000342,"redis_cache_read_bytes":44,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006151,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.011588,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000617,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.059,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.057,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.325267,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.488693,"completed_at":"2026-08-20T08:53:18.649Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.058552,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2147gitlab # [ 247.363319] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:18.650Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"16d3e8b3-2745-461f-ac57-0186871fa8f6\"}"],"class":"WebHookWorker","jid":"7846abf47dbad48f921cb366","created_at":"2026-08-20T08:53:16.295Z","trace_propagation_headers":{"sentry-trace":"df45df268ba94c4882b68afc416d3d49-38991dfec95b43ae","baggage":"sentry-trace_id=df45df268ba94c4882b68afc416d3d49,sentry-release=Unknown"},"correlation_id":"01M0F5YABGHEET032Y6TE1W821","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73fe22f34e20df4cd0693df9acbf979324d67aa123af41c9bc94fbd986666ce9","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:16.296Z","job_size_bytes":1749,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-7846abf47dbad48f921cb366: start","job_status":"start","queue_duration_s":2.354376,"scheduling_latency_s":2.354394}2148gitlab # [ 247.382924] nixbot[2605]: INFO: ::ffff:127.0.0.1:41252 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2149gitlab # [ 247.392577] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:18.681Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"16d3e8b3-2745-461f-ac57-0186871fa8f6\"}"],"class":"WebHookWorker","jid":"7846abf47dbad48f921cb366","created_at":"2026-08-20T08:53:16.295Z","trace_propagation_headers":{"sentry-trace":"df45df268ba94c4882b68afc416d3d49-38991dfec95b43ae","baggage":"sentry-trace_id=df45df268ba94c4882b68afc416d3d49,sentry-release=Unknown"},"correlation_id":"01M0F5YABGHEET032Y6TE1W821","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73fe22f34e20df4cd0693df9acbf979324d67aa123af41c9bc94fbd986666ce9","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:16.296Z","job_size_bytes":1749,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-7846abf47dbad48f921cb366: done: 0.03044 sec","job_status":"done","queue_duration_s":2.354376,"scheduling_latency_s":2.354394,"redis_calls":14,"redis_duration_s":0.003413,"redis_read_bytes":26,"redis_write_bytes":4682,"redis_queues_calls":2,"redis_queues_duration_s":0.000694,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3726,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001966,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000753,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.006420089999977563,"cpu_s":0.016337,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.03044,"completed_at":"2026-08-20T08:53:18.681Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001775,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2150gitlab # [ 247.430370] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:18.684Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"3882caea2a45f9234d4d513b","created_at":"2026-08-20T08:53:16.691Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-55da0f5f58674b28","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:16.694Z","job_size_bytes":23,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-3882caea2a45f9234d4d513b: start","job_status":"start","queue_duration_s":1.989105,"scheduling_latency_s":1.989126}2151gitlab # [ 247.442420] gitaly[920]: time="2026-08-20T08:53:18.731Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0F5ZVQ33YF59TANHD9QY5J0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:53:18.724" grpc.time_ms=6.412 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc2152gitlab # [ 247.443168] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:53:18 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 402153gitlab # [ 247.450109] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:18.738Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"3882caea2a45f9234d4d513b","created_at":"2026-08-20T08:53:16.691Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-55da0f5f58674b28","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:16.694Z","job_size_bytes":23,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-3882caea2a45f9234d4d513b: done: 0.054938 sec","job_status":"done","queue_duration_s":1.989105,"scheduling_latency_s":1.989126,"redis_calls":10,"redis_duration_s":0.001407,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000276,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000862,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000269,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036823,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000244165,"duration_s":0.054938,"completed_at":"2026-08-20T08:53:18.738Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013732,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2154gitlab # [ 247.489729] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:18.740Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"5cbe096521b73f5f1497450c","created_at":"2026-08-20T08:53:16.876Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-55da0f5f58674b28","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:16.882Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-5cbe096521b73f5f1497450c: start","job_status":"start","queue_duration_s":1.857291,"scheduling_latency_s":1.85736}2155gitlab # [ 247.491791] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:18.762Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"5cbe096521b73f5f1497450c","created_at":"2026-08-20T08:53:16.876Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-55da0f5f58674b28","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:16.882Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-5cbe096521b73f5f1497450c: done: 0.022139 sec","job_status":"done","queue_duration_s":1.857291,"scheduling_latency_s":1.85736,"redis_calls":10,"redis_duration_s":0.002262,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000367,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001278,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000617,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012802,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000269308,"duration_s":0.022139,"completed_at":"2026-08-20T08:53:18.762Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004208,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2156gitlab # [ 247.527715] gitlab-workhorse[824]: time="2026-08-20T08:53:18Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672157gitlab # [ 247.528575] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:53:18 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 452158gitlab # [ 247.529882] gitaly[920]: time="2026-08-20T08:53:18.776Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5ZVRD7V9YA85794N51DK9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:53:18.768" pid=920 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2159gitlab # [ 247.538396] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:18.763Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"0a20eff2e7060cf043d03823","created_at":"2026-08-20T08:53:16.896Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-55da0f5f58674b28","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:16.903Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-0a20eff2e7060cf043d03823: start","job_status":"start","queue_duration_s":1.860383,"scheduling_latency_s":1.860396}2160gitlab # [ 247.576596] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:18.795Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"0a20eff2e7060cf043d03823","created_at":"2026-08-20T08:53:16.896Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-55da0f5f58674b28","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:16.903Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-0a20eff2e7060cf043d03823: done: 0.031767 sec","job_status":"done","queue_duration_s":1.860383,"scheduling_latency_s":1.860396,"redis_calls":10,"redis_duration_s":0.004237,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000331,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00222,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001686,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017389,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000890895,"duration_s":0.031767,"completed_at":"2026-08-20T08:53:18.795Z","load_balancing_strategy":"primary","db_duration_s":0.007259,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2161gitlab # [ 247.587574] gitaly[920]: time="2026-08-20T08:53:18.776Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5ZVRD7V9YA85794N51DK9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:53:18.768" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc2162gitlab # [ 247.600153] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:53:18 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 512163gitlab # [ 247.600726] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:18.796Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"8ec21ebde8aec0e1c44c3047","created_at":"2026-08-20T08:53:16.917Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-55da0f5f58674b28","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:16.923Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-8ec21ebde8aec0e1c44c3047: start","job_status":"start","queue_duration_s":1.872939,"scheduling_latency_s":1.873014}2164gitlab # [ 247.646116] nix-daemon[2824]: accepted connection from pid 3294, user nixbot2165gitlab # [ 247.646761] gitaly[920]: time="2026-08-20T08:53:18.777Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5ZVRD7V9YA85794N51DK9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:53:18.768" grpc.time_ms=8.794 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc2166gitlab # [ 247.647376] gitlab-workhorse[824]: time="2026-08-20T08:53:18Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672167gitlab # [ 247.647769] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:53:18 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 412168gitlab # [ 247.648403] gitaly[920]: time="2026-08-20T08:53:18.859Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=5 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0F5ZVTQV6RW3N9BS6X1QHS9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:53:18.849" grpc.time_ms=9.549 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc2169gitlab # [ 247.649064] gitaly[920]: time="2026-08-20T08:53:18.902Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5ZVWD3ED87BV4AXSBK4MK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:53:18.894" pid=920 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2170gitlab # [ 247.649612] gitaly[920]: time="2026-08-20T08:53:18.902Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5ZVWD3ED87BV4AXSBK4MK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:53:18.894" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc2171gitlab # [ 247.689907] gitaly[920]: time="2026-08-20T08:53:18.903Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5ZVWD3ED87BV4AXSBK4MK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:53:18.894" grpc.time_ms=8.279 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc2172gitlab # [ 247.690596] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:53:18 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 442173gitlab # [ 247.691083] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:18.946Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"8ec21ebde8aec0e1c44c3047","created_at":"2026-08-20T08:53:16.917Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-55da0f5f58674b28","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:16.923Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-8ec21ebde8aec0e1c44c3047: done: 0.150598 sec","job_status":"done","queue_duration_s":1.872939,"scheduling_latency_s":1.873014,"redis_calls":13,"redis_duration_s":0.001832,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000343,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000799,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000407,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000283,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.090591,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000229079,"duration_s":0.150598,"completed_at":"2026-08-20T08:53:18.946Z","load_balancing_strategy":"primary","db_duration_s":0.005609,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2174gitlab # [ 247.706681] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:18.948Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"e9ea8ebb0ec7af3eb44ccf1b","created_at":"2026-08-20T08:53:16.924Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-55da0f5f58674b28","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:16.928Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-e9ea8ebb0ec7af3eb44ccf1b: start","job_status":"start","queue_duration_s":2.019414,"scheduling_latency_s":2.019431}2175gitlab # [ 247.743169] gitaly[920]: time="2026-08-20T08:53:18.972Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F5ZVYGX16G9SKMYV74ZTMX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:53:18.964" grpc.time_ms=7.98 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc2176gitlab # [ 247.743793] gitaly[920]: time="2026-08-20T08:53:19.021Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5ZVZY15KJNHB82RFGBN28 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:53:19.010" pid=920 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2177gitlab # [ 247.744413] gitlab-workhorse[824]: time="2026-08-20T08:53:19Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162178gitlab # [ 247.744802] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:53:19 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 482179gitlab # [ 247.745455] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:18.973Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"e9ea8ebb0ec7af3eb44ccf1b","created_at":"2026-08-20T08:53:16.924Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-55da0f5f58674b28","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:16.928Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-e9ea8ebb0ec7af3eb44ccf1b: done: 0.025328 sec","job_status":"done","queue_duration_s":2.019414,"scheduling_latency_s":2.019431,"redis_calls":10,"redis_duration_s":0.001887,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000669,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000962,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000256,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014448,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000284673,"duration_s":0.025328,"completed_at":"2026-08-20T08:53:18.973Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004203,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2180gitlab # [ 247.782385] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:18.974Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"cb3bb2ed3c76f2f7b686d865","created_at":"2026-08-20T08:53:16.929Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-55da0f5f58674b28","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:16.934Z","job_size_bytes":19,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-cb3bb2ed3c76f2f7b686d865: start","job_status":"start","queue_duration_s":2.039825,"scheduling_latency_s":2.039839}2181gitlab # [ 247.795213] gitaly[920]: time="2026-08-20T08:53:19.021Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1168 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5ZVZY15KJNHB82RFGBN28 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:53:19.010" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc2182gitlab # [ 247.804157] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:18.999Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"cb3bb2ed3c76f2f7b686d865","created_at":"2026-08-20T08:53:16.929Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-55da0f5f58674b28","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:16.934Z","job_size_bytes":19,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-cb3bb2ed3c76f2f7b686d865: done: 0.02456 sec","job_status":"done","queue_duration_s":2.039825,"scheduling_latency_s":2.039839,"redis_calls":11,"redis_duration_s":0.002455,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000276,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001907,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000272,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012213,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000372952,"duration_s":0.02456,"completed_at":"2026-08-20T08:53:18.999Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006079,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2183gitlab # [ 247.845246] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.001Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"cde580e0844c793d2a79d6d5","created_at":"2026-08-20T08:53:16.938Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-55da0f5f58674b28","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:16.941Z","job_size_bytes":66,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-cde580e0844c793d2a79d6d5: start","job_status":"start","queue_duration_s":2.059927,"scheduling_latency_s":2.059941}2184gitlab # [ 247.852680] gitaly[920]: time="2026-08-20T08:53:19.021Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1168 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5ZVZY15KJNHB82RFGBN28 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:53:19.010" grpc.time_ms=10.915 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc2185gitlab # [ 247.899757] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.036Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"cde580e0844c793d2a79d6d5","created_at":"2026-08-20T08:53:16.938Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-55da0f5f58674b28","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:16.941Z","job_size_bytes":66,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-cde580e0844c793d2a79d6d5: done: 0.034694 sec","job_status":"done","queue_duration_s":2.059927,"scheduling_latency_s":2.059941,"redis_calls":10,"redis_duration_s":0.002089,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000529,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001219,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000341,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013932,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000274616,"duration_s":0.034694,"completed_at":"2026-08-20T08:53:19.036Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014495,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2186gitlab # [ 247.901291] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.037Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"53c112d08bf3c8bc1912cec8","created_at":"2026-08-20T08:53:16.942Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-55da0f5f58674b28","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:16.944Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-53c112d08bf3c8bc1912cec8: start","job_status":"start","queue_duration_s":2.092216,"scheduling_latency_s":2.092231}2187gitlab # [ 247.914886] gitaly[920]: time="2026-08-20T08:53:19.126Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5ZW2J1P5TDJYK9P9ZZHTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:53:49.125" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:53:19.125" grpc.time_ms=0.65 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2188gitlab # [ 247.925846] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.065Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"53c112d08bf3c8bc1912cec8","created_at":"2026-08-20T08:53:16.942Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-55da0f5f58674b28","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:16.944Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-53c112d08bf3c8bc1912cec8: done: 0.028896 sec","job_status":"done","queue_duration_s":2.092216,"scheduling_latency_s":2.092231,"redis_calls":10,"redis_duration_s":0.00165,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000259,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000884,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000507,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019096,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000225727,"duration_s":0.028896,"completed_at":"2026-08-20T08:53:19.065Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004649,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2189gitlab # [ 247.963768] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.067Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"bd495ff34c6f60107d707156","created_at":"2026-08-20T08:53:16.949Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-55da0f5f58674b28","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:16.951Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-bd495ff34c6f60107d707156: start","job_status":"start","queue_duration_s":2.115111,"scheduling_latency_s":2.115128}2190gitlab # [ 247.999758] gitaly[920]: time="2026-08-20T08:53:19.139Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=649 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0F5ZW2J1P5TDJYK9P9ZZHTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-20T08:53:49.131" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:53:19.131" grpc.time_ms=8.392 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2191gitlab # [ 248.000524] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.108Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"bd495ff34c6f60107d707156","created_at":"2026-08-20T08:53:16.949Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-55da0f5f58674b28","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:16.951Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-bd495ff34c6f60107d707156: done: 0.04181 sec","job_status":"done","queue_duration_s":2.115111,"scheduling_latency_s":2.115128,"redis_calls":10,"redis_duration_s":0.007606,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000711,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002499,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004396,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016675,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000226006,"duration_s":0.04181,"completed_at":"2026-08-20T08:53:19.108Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014451,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2192gitlab # [ 248.037940] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.109Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"2ef8316f39f519448d23dc5a","created_at":"2026-08-20T08:53:16.952Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-55da0f5f58674b28","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:16.954Z","job_size_bytes":6,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-2ef8316f39f519448d23dc5a: start","job_status":"start","queue_duration_s":2.155057,"scheduling_latency_s":2.155071}2193gitlab # [ 248.038630] gitaly[920]: time="2026-08-20T08:53:19.149Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F5ZW2J1P5TDJYK9P9ZZHTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:53:29.133" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:53:19.144" grpc.time_ms=5.146 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2194gitlab # [ 248.076718] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.128Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"2ef8316f39f519448d23dc5a","created_at":"2026-08-20T08:53:16.952Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-55da0f5f58674b28","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:16.954Z","job_size_bytes":6,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-2ef8316f39f519448d23dc5a: done: 0.018134 sec","job_status":"done","queue_duration_s":2.155057,"scheduling_latency_s":2.155071,"redis_calls":10,"redis_duration_s":0.0013289999999999999,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000248,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000802,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000279,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01021,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000218743,"duration_s":0.018134,"completed_at":"2026-08-20T08:53:19.127Z","load_balancing_strategy":"primary","db_duration_s":0.001462,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2195gitlab # [ 248.080254] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.130Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"2ec4e638e39aaa6b8979476d","created_at":"2026-08-20T08:53:16.955Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-55da0f5f58674b28","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:16.958Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-2ec4e638e39aaa6b8979476d: start","job_status":"start","queue_duration_s":2.172592,"scheduling_latency_s":2.172607}2196gitlab # [ 248.123841] nixbot[2605]: {"ts": "2026-08-20T08:53:19.329Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 \"HTTP/1.1 201 Created\""}2197gitlab # [ 248.124530] nixbot[2605]: {"ts": "2026-08-20T08:53:19.334Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-361c5ea7d2ec-4"}2198gitlab # [ 248.125312] gitaly[920]: time="2026-08-20T08:53:19.184Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5ZW2J1P5TDJYK9P9ZZHTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T08:53:29.173" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:53:19.184" grpc.time_ms=0.214 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2199gitlab # [ 248.142313] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:53:19 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 2692200gitlab # [ 248.143063] nix-daemon[2824]: accepted connection from pid 3352, user nixbot2201gitlab # [ 248.143579] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.174Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"2ec4e638e39aaa6b8979476d","created_at":"2026-08-20T08:53:16.955Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-55da0f5f58674b28","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:16.958Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-2ec4e638e39aaa6b8979476d: done: 0.043642 sec","job_status":"done","queue_duration_s":2.172592,"scheduling_latency_s":2.172607,"redis_calls":10,"redis_duration_s":0.008998,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000682,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003812,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004504,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015338,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000982247,"duration_s":0.043642,"completed_at":"2026-08-20T08:53:19.174Z","load_balancing_strategy":"primary","db_duration_s":0.016514,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2202gitlab # [ 248.146116] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.177Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"a21c7f9c2dfe850d6afc7177","created_at":"2026-08-20T08:53:16.962Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-55da0f5f58674b28","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:16.965Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-a21c7f9c2dfe850d6afc7177: start","job_status":"start","queue_duration_s":2.2124,"scheduling_latency_s":2.212416}2203gitlab # [ 248.157184] gitaly[920]: time="2026-08-20T08:53:19.194Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5ZW2J1P5TDJYK9P9ZZHTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T08:53:29.177" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:53:19.187" grpc.time_ms=6.213 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2204gitlab # [ 248.200234] gitaly[920]: time="2026-08-20T08:53:19.226Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F5ZW2J1P5TDJYK9P9ZZHTT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:53:19.225" grpc.time_ms=0.257 pid=920 span.kind=server system=grpc2205gitlab # [ 248.200809] nix-daemon[2824]: accepted connection from pid 3360, user nixbot2206gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3'2207gitlab # [ 248.201656] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.226Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"a21c7f9c2dfe850d6afc7177","created_at":"2026-08-20T08:53:16.962Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-55da0f5f58674b28","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:16.965Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-a21c7f9c2dfe850d6afc7177: done: 0.048939 sec","job_status":"done","queue_duration_s":2.2124,"scheduling_latency_s":2.212416,"redis_calls":14,"redis_duration_s":0.003587,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000382,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002168,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001037,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029291,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000213715,"duration_s":0.048939,"completed_at":"2026-08-20T08:53:19.226Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008105,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2208gitlab # [ 248.211726] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.227Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"0fa6e22d7f44e3c11099d02d","created_at":"2026-08-20T08:53:17.035Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-55da0f5f58674b28","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:17.036Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0fa6e22d7f44e3c11099d02d: start","job_status":"start","queue_duration_s":2.190872,"scheduling_latency_s":2.190888}2209gitlab # [ 248.250283] gitaly[920]: time="2026-08-20T08:53:19.245Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F5ZW2J1P5TDJYK9P9ZZHTT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:53:19.245" grpc.time_ms=0.344 pid=920 span.kind=server system=grpc2210gitlab # [ 248.250830] gitaly[920]: time="2026-08-20T08:53:19.255Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5ZW2J1P5TDJYK9P9ZZHTT diskcache=adc2e422-964a-49f4-a03b-b8b7cfee2a35 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T08:53:29.185" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:53:19.195" pid=920 ref=refs/keep-around/361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 remote_ip="2001:db8:1::1" revision=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 span.kind=server system=grpc username=root2211gitlab # [ 248.252570] nixbot[2605]: {"ts": "2026-08-20T08:53:19.519Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-361c5ea7d2ec-4", "argv0": "bwrap"}2212gitlab # [ 248.253206] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.318Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"0fa6e22d7f44e3c11099d02d","created_at":"2026-08-20T08:53:17.035Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-55da0f5f58674b28","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:17.036Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2557,"job_status":"rescheduled","message":"PipelineProcessWorker JID-0fa6e22d7f44e3c11099d02d: rescheduled"}2213gitlab # [ 248.253729] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.323Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"0fa6e22d7f44e3c11099d02d","created_at":"2026-08-20T08:53:17.035Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-55da0f5f58674b28","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:17.036Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0fa6e22d7f44e3c11099d02d: done: 0.096256 sec","job_status":"done","queue_duration_s":2.190872,"scheduling_latency_s":2.190888,"gitaly_calls":2,"gitaly_duration_s":0.005241,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.006427,"redis_read_bytes":59,"redis_write_bytes":6218,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000949,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":8,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000487,"redis_cache_read_bytes":16,"redis_cache_write_bytes":735,"redis_queues_calls":4,"redis_queues_duration_s":0.000334,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2221,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.002043,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":979,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000479,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.00027,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":29,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":29,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":14,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.063915,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.070343577,"duration_s":0.096256,"completed_at":"2026-08-20T08:53:19.323Z","load_balancing_strategy":"primary","db_duration_s":0.024415,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2214gitlab # [ 248.319198] gitaly[920]: time="2026-08-20T08:53:19.255Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=43 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5130 command.oublock=8 command.real_time_ms=53 command.spawn_token_fork_ms=2 command.system_time_ms=28 command.user_time_ms=15 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5ZW2J1P5TDJYK9P9ZZHTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T08:53:29.185" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:53:19.195" grpc.time_ms=60.128 pid=920 ref=refs/keep-around/361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 remote_ip="2001:db8:1::1" revision=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 span.kind=server system=grpc username=root2215gitlab # [ 248.319819] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:53:19 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/9494aaa3888aca4a4baa3113363b88e142f740a7 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 9502216gitlab # [ 248.320386] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.324Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"cb3c6b6abbc41480ad513df3","created_at":"2026-08-20T08:53:17.107Z","trace_propagation_headers":{"sentry-trace":"3df3413170b44608bc071f60319e9391-6ddd5ca66e914445","baggage":"sentry-trace_id=3df3413170b44608bc071f60319e9391,sentry-release=Unknown"},"correlation_id":"01M0F5Y6KE3JCH97SB8C2E4C9N","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:17.113Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-cb3c6b6abbc41480ad513df3: start","job_status":"start","queue_duration_s":2.211431,"scheduling_latency_s":2.211446}2217gitlab # [ 248.321974] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.362Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"cb3c6b6abbc41480ad513df3","created_at":"2026-08-20T08:53:17.107Z","trace_propagation_headers":{"sentry-trace":"3df3413170b44608bc071f60319e9391-6ddd5ca66e914445","baggage":"sentry-trace_id=3df3413170b44608bc071f60319e9391,sentry-release=Unknown"},"correlation_id":"01M0F5Y6KE3JCH97SB8C2E4C9N","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:17.113Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-cb3c6b6abbc41480ad513df3: done: 0.037732 sec","job_status":"done","queue_duration_s":2.211431,"scheduling_latency_s":2.211446,"redis_calls":19,"redis_duration_s":0.005105,"redis_read_bytes":21,"redis_write_bytes":4291,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001264,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000333,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2262,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002132,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001376,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025605,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.006293817,"duration_s":0.037732,"completed_at":"2026-08-20T08:53:19.362Z","load_balancing_strategy":"primary","db_duration_s":0.004666,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2218gitlab # [ 248.359064] gitaly[920]: time="2026-08-20T08:53:19.259Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5ZW2J1P5TDJYK9P9ZZHTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:53:49.258" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:53:19.259" grpc.time_ms=0.442 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2219gitlab # [ 248.368625] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.363Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","cf2138f3445884228913c6cc"],"class":"WebHooks::LogExecutionWorker","jid":"b4cb15fef894f28ad5058626","created_at":"2026-08-20T08:53:17.991Z","trace_propagation_headers":{"sentry-trace":"3df3413170b44608bc071f60319e9391-a87b0656cdb34b38","baggage":"sentry-trace_id=3df3413170b44608bc071f60319e9391,sentry-release=Unknown"},"correlation_id":"01M0F5Y6KE3JCH97SB8C2E4C9N","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:05c7940246a7c79472fbd4006ea00e9be156eebfea7d9bacdabf2a485ba60c77","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:17.996Z","job_size_bytes":2593,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-b4cb15fef894f28ad5058626: start","job_status":"start","queue_duration_s":1.366846,"scheduling_latency_s":1.36686}2220gitlab # [ 248.405527] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.394Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","cf2138f3445884228913c6cc"],"class":"WebHooks::LogExecutionWorker","jid":"b4cb15fef894f28ad5058626","created_at":"2026-08-20T08:53:17.991Z","trace_propagation_headers":{"sentry-trace":"3df3413170b44608bc071f60319e9391-a87b0656cdb34b38","baggage":"sentry-trace_id=3df3413170b44608bc071f60319e9391,sentry-release=Unknown"},"correlation_id":"01M0F5Y6KE3JCH97SB8C2E4C9N","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:05c7940246a7c79472fbd4006ea00e9be156eebfea7d9bacdabf2a485ba60c77","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:17.996Z","job_size_bytes":2593,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-b4cb15fef894f28ad5058626: done: 0.030703 sec","job_status":"done","queue_duration_s":1.366846,"scheduling_latency_s":1.36686,"redis_calls":10,"redis_duration_s":0.001294,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00027,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000775,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000249,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020265,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000232711,"duration_s":0.030703,"completed_at":"2026-08-20T08:53:19.394Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005817,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2221gitlab # [ 248.417939] gitaly[920]: time="2026-08-20T08:53:19.291Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F5YB7EGS4WK7HWWG5MRVQC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T08:53:49.190" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:53:19.290" grpc.time_ms=0.515 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2222gitlab # [ 248.428399] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.395Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","7846abf47dbad48f921cb366"],"class":"WebHooks::LogExecutionWorker","jid":"d8ae512cd9dfcb9fb5a58785","created_at":"2026-08-20T08:53:18.672Z","trace_propagation_headers":{"sentry-trace":"df45df268ba94c4882b68afc416d3d49-f1fea54e1d294731","baggage":"sentry-trace_id=df45df268ba94c4882b68afc416d3d49,sentry-release=Unknown"},"correlation_id":"01M0F5YABGHEET032Y6TE1W821","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b43b949fdaf3a97a4139670b7d71dce93d6b758dcbff169e9b7879361d20e6c2","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:18.674Z","job_size_bytes":2591,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-d8ae512cd9dfcb9fb5a58785: start","job_status":"start","queue_duration_s":0.720954,"scheduling_latency_s":0.720967}2223gitlab # [ 248.441861] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.411Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","7846abf47dbad48f921cb366"],"class":"WebHooks::LogExecutionWorker","jid":"d8ae512cd9dfcb9fb5a58785","created_at":"2026-08-20T08:53:18.672Z","trace_propagation_headers":{"sentry-trace":"df45df268ba94c4882b68afc416d3d49-f1fea54e1d294731","baggage":"sentry-trace_id=df45df268ba94c4882b68afc416d3d49,sentry-release=Unknown"},"correlation_id":"01M0F5YABGHEET032Y6TE1W821","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b43b949fdaf3a97a4139670b7d71dce93d6b758dcbff169e9b7879361d20e6c2","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:18.674Z","job_size_bytes":2591,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-d8ae512cd9dfcb9fb5a58785: done: 0.016095 sec","job_status":"done","queue_duration_s":0.720954,"scheduling_latency_s":0.720967,"redis_calls":7,"redis_duration_s":0.001103,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000659,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000444,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01035,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016095,"completed_at":"2026-08-20T08:53:19.411Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002862,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2224gitlab # [ 248.489726] gitaly[920]: time="2026-08-20T08:53:19.313Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YB7EGS4WK7HWWG5MRVQC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:53:49.212" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:53:19.313" grpc.time_ms=0.571 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2225gitlab # [ 248.490474] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.412Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"e6fdfd5fbd2d87efaeef4a8c","created_at":"2026-08-20T08:53:19.260Z","trace_propagation_headers":{"sentry-trace":"5d0c43111e35435f92eda5626882c1b8-f84afdfb26bf4352","baggage":"sentry-trace_id=5d0c43111e35435f92eda5626882c1b8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F5ZW2J1P5TDJYK9P9ZZHTT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:19.262Z","job_size_bytes":65,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-e6fdfd5fbd2d87efaeef4a8c: start","job_status":"start","queue_duration_s":0.149397,"scheduling_latency_s":0.149411}2226gitlab # [ 248.500820] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.451Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"e6fdfd5fbd2d87efaeef4a8c","created_at":"2026-08-20T08:53:19.260Z","trace_propagation_headers":{"sentry-trace":"5d0c43111e35435f92eda5626882c1b8-f84afdfb26bf4352","baggage":"sentry-trace_id=5d0c43111e35435f92eda5626882c1b8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F5ZW2J1P5TDJYK9P9ZZHTT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:19.262Z","job_size_bytes":65,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-e6fdfd5fbd2d87efaeef4a8c: done: 0.039429 sec","job_status":"done","queue_duration_s":0.149397,"scheduling_latency_s":0.149411,"redis_calls":7,"redis_duration_s":0.002469,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002156,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000313,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013137,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039429,"completed_at":"2026-08-20T08:53:19.451Z","load_balancing_strategy":"primary","db_duration_s":0.014679,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2227gitlab # [ 248.536173] gitaly[920]: time="2026-08-20T08:53:19.467Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5ZVMVX5PWHF9PZWWX2W3B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:53:49.165" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:53:19.465" grpc.time_ms=1.423 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2228gitlab # [ 248.580538] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.454Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"e2a9c73a115d418e7a4cad48","created_at":"2026-08-20T08:53:19.264Z","trace_propagation_headers":{"sentry-trace":"5d0c43111e35435f92eda5626882c1b8-f84afdfb26bf4352","baggage":"sentry-trace_id=5d0c43111e35435f92eda5626882c1b8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F5ZW2J1P5TDJYK9P9ZZHTT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:19.265Z","job_size_bytes":65,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-e2a9c73a115d418e7a4cad48: start","job_status":"start","queue_duration_s":0.188828,"scheduling_latency_s":0.188861}2229gitlab # [ 248.581168] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.496Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"e2a9c73a115d418e7a4cad48","created_at":"2026-08-20T08:53:19.264Z","trace_propagation_headers":{"sentry-trace":"5d0c43111e35435f92eda5626882c1b8-f84afdfb26bf4352","baggage":"sentry-trace_id=5d0c43111e35435f92eda5626882c1b8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F5ZW2J1P5TDJYK9P9ZZHTT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:19.265Z","job_size_bytes":65,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-e2a9c73a115d418e7a4cad48: done: 0.042588 sec","job_status":"done","queue_duration_s":0.188828,"scheduling_latency_s":0.188861,"redis_calls":10,"redis_duration_s":0.00289,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001825,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001065,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025083,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042588,"completed_at":"2026-08-20T08:53:19.496Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010134,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2230gitlab # [ 248.624047] gitaly[920]: time="2026-08-20T08:53:19.501Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0F5ZVMVX5PWHF9PZWWX2W3B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:53:29.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:53:19.495" grpc.time_ms=5.741 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2231gitlab # [ 248.624606] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.498Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"4478305cd22d342568cc6664","created_at":"2026-08-20T08:53:19.278Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-be5e13f8b57f4b47","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:19.280Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-4478305cd22d342568cc6664: start","job_status":"start","queue_duration_s":0.217505,"scheduling_latency_s":0.217522}2232gitlab # [ 248.625173] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.522Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"4478305cd22d342568cc6664","created_at":"2026-08-20T08:53:19.278Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-be5e13f8b57f4b47","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:19.280Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-4478305cd22d342568cc6664: done: 0.024863 sec","job_status":"done","queue_duration_s":0.217505,"scheduling_latency_s":0.217522,"redis_calls":7,"redis_duration_s":0.001294,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000999,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000295,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017597,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024863,"completed_at":"2026-08-20T08:53:19.522Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003778,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2233gitlab # [ 248.673184] gitaly[920]: time="2026-08-20T08:53:19.598Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F5ZW2J1P5TDJYK9P9ZZHTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T08:53:49.497" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:53:19.598" grpc.time_ms=0.712 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2234gitlab # [ 248.673735] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.534Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"214542f3a8943bbd68a5c693","created_at":"2026-08-20T08:53:19.315Z","trace_propagation_headers":{"sentry-trace":"5d0c43111e35435f92eda5626882c1b8-f84afdfb26bf4352","baggage":"sentry-trace_id=5d0c43111e35435f92eda5626882c1b8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F5ZW2J1P5TDJYK9P9ZZHTT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:19.317Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-214542f3a8943bbd68a5c693: start","job_status":"start","queue_duration_s":0.216964,"scheduling_latency_s":0.216987}2235gitlab # [ 248.675426] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.627Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"214542f3a8943bbd68a5c693","created_at":"2026-08-20T08:53:19.315Z","trace_propagation_headers":{"sentry-trace":"5d0c43111e35435f92eda5626882c1b8-f84afdfb26bf4352","baggage":"sentry-trace_id=5d0c43111e35435f92eda5626882c1b8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F5ZW2J1P5TDJYK9P9ZZHTT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:19.317Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-214542f3a8943bbd68a5c693: done: 0.092636 sec","job_status":"done","queue_duration_s":0.216964,"scheduling_latency_s":0.216987,"gitaly_calls":2,"gitaly_duration_s":0.004296,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.007066,"redis_read_bytes":79,"redis_write_bytes":5121,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.00086,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000618,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000177,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1132,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00094,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000149,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000438,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003024,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.058914,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.059461188,"duration_s":0.092636,"completed_at":"2026-08-20T08:53:19.627Z","load_balancing_strategy":"primary","db_duration_s":0.01845,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2236gitlab # [ 248.722024] gitaly[920]: time="2026-08-20T08:53:19.620Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5ZW2J1P5TDJYK9P9ZZHTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:53:49.519" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:53:19.619" grpc.time_ms=0.456 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2237gitlab # [ 248.726146] gitaly[920]: time="2026-08-20T08:53:19.726Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F5YB7EGS4WK7HWWG5MRVQC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:53:19.725" grpc.time_ms=0.334 pid=920 span.kind=server system=grpc2238gitlab # [ 248.734135] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.628Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"07bf4ec89446eadea98dda6f","created_at":"2026-08-20T08:53:19.318Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-be5e13f8b57f4b47","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:19.319Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-07bf4ec89446eadea98dda6f: start","job_status":"start","queue_duration_s":0.308346,"scheduling_latency_s":0.308361}2239gitlab # [ 248.746662] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.827Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"07bf4ec89446eadea98dda6f","created_at":"2026-08-20T08:53:19.318Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-be5e13f8b57f4b47","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:19.319Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2557,"job_status":"rescheduled","message":"PipelineProcessWorker JID-07bf4ec89446eadea98dda6f: rescheduled"}2240gitlab # [ 248.758627] gitaly[920]: time="2026-08-20T08:53:19.743Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F5YB7EGS4WK7HWWG5MRVQC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3890 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:53:19.742" grpc.time_ms=0.408 pid=920 span.kind=server system=grpc2241gitlab # [ 248.800099] gitaly[920]: time="2026-08-20T08:53:19.759Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F5YB7EGS4WK7HWWG5MRVQC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:53:19.759" grpc.time_ms=0.284 pid=920 span.kind=server system=grpc2242gitlab # [ 248.801101] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.831Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"07bf4ec89446eadea98dda6f","created_at":"2026-08-20T08:53:19.318Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-be5e13f8b57f4b47","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:19.319Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-07bf4ec89446eadea98dda6f: done: 0.203324 sec","job_status":"done","queue_duration_s":0.308346,"scheduling_latency_s":0.308361,"gitaly_calls":3,"gitaly_duration_s":0.069286,"redis_calls":74,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.008179,"redis_read_bytes":158,"redis_write_bytes":21169,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000621,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000562,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":25,"redis_queues_duration_s":0.002063,"redis_queues_read_bytes":30,"redis_queues_write_bytes":14464,"redis_queues_metadata_calls":20,"redis_queues_metadata_duration_s":0.002869,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3301,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000151,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00032,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.000972,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.035,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.037,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.080217,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.182484086,"duration_s":0.203324,"completed_at":"2026-08-20T08:53:19.831Z","load_balancing_strategy":"primary","db_duration_s":0.05232,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2243gitlab # [ 248.814900] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.832Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"31b0e8c60f90b2acaaae982b","created_at":"2026-08-20T08:53:19.351Z","trace_propagation_headers":{"sentry-trace":"3df3413170b44608bc071f60319e9391-20dc8277e12f401c","baggage":"sentry-trace_id=3df3413170b44608bc071f60319e9391,sentry-release=Unknown"},"correlation_id":"01M0F5Y6KE3JCH97SB8C2E4C9N","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:19.355Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-31b0e8c60f90b2acaaae982b: start","job_status":"start","queue_duration_s":0.4767,"scheduling_latency_s":0.476715}2244gitlab # [ 248.853308] gitaly[920]: time="2026-08-20T08:53:19.769Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YB7EGS4WK7HWWG5MRVQC diskcache=e825a2b7-ecde-4735-8926-237779d55c45 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T08:53:49.605" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:53:19.706" pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2245gitlab # [ 248.853840] gitaly[920]: time="2026-08-20T08:53:19.769Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=61 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7193 command.oublock=0 command.real_time_ms=56 command.spawn_token_fork_ms=0 command.system_time_ms=41 command.user_time_ms=20 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YB7EGS4WK7HWWG5MRVQC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T08:53:49.605" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:53:19.706" grpc.time_ms=63.101 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2246gitlab # [ 248.854494] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.886Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"31b0e8c60f90b2acaaae982b","created_at":"2026-08-20T08:53:19.351Z","trace_propagation_headers":{"sentry-trace":"3df3413170b44608bc071f60319e9391-20dc8277e12f401c","baggage":"sentry-trace_id=3df3413170b44608bc071f60319e9391,sentry-release=Unknown"},"correlation_id":"01M0F5Y6KE3JCH97SB8C2E4C9N","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:19.355Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-31b0e8c60f90b2acaaae982b: done: 0.053959 sec","job_status":"done","queue_duration_s":0.4767,"scheduling_latency_s":0.476715,"redis_calls":11,"redis_duration_s":0.001641,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000258,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001128,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000255,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037943,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00039614,"duration_s":0.053959,"completed_at":"2026-08-20T08:53:19.886Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012294,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2247gitlab # [ 248.906640] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.887Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"b807d479489477d5e7728fd5","created_at":"2026-08-20T08:53:19.587Z","trace_propagation_headers":{"sentry-trace":"5d0c43111e35435f92eda5626882c1b8-63b18b4f741a4b0f","baggage":"sentry-trace_id=5d0c43111e35435f92eda5626882c1b8,sentry-release=Unknown"},"correlation_id":"01M0F5ZW2J1P5TDJYK9P9ZZHTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:19.589Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-b807d479489477d5e7728fd5: start","job_status":"start","queue_duration_s":0.298293,"scheduling_latency_s":0.298307}2248gitlab # [ 248.907453] gitaly[920]: time="2026-08-20T08:53:19.804Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F5YB7EGS4WK7HWWG5MRVQC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T08:53:49.703" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:53:19.804" grpc.time_ms=0.565 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2249gitlab # [ 248.908083] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.908Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"b807d479489477d5e7728fd5","created_at":"2026-08-20T08:53:19.587Z","trace_propagation_headers":{"sentry-trace":"5d0c43111e35435f92eda5626882c1b8-63b18b4f741a4b0f","baggage":"sentry-trace_id=5d0c43111e35435f92eda5626882c1b8,sentry-release=Unknown"},"correlation_id":"01M0F5ZW2J1P5TDJYK9P9ZZHTT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:19.589Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-b807d479489477d5e7728fd5: done: 0.021255 sec","job_status":"done","queue_duration_s":0.298293,"scheduling_latency_s":0.298307,"redis_calls":7,"redis_duration_s":0.000858,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000626,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000232,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015837,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021255,"completed_at":"2026-08-20T08:53:19.908Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002784,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2250gitlab # [ 248.939071] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.909Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"9c12bc70c6fa1cf9313182a3","created_at":"2026-08-20T08:53:19.700Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-795c6b4919d34034","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:19.702Z","job_size_bytes":23,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-9c12bc70c6fa1cf9313182a3: start","job_status":"start","queue_duration_s":0.207784,"scheduling_latency_s":0.207798}2251gitlab # [ 248.979525] gitaly[920]: time="2026-08-20T08:53:19.822Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5YB7EGS4WK7HWWG5MRVQC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:53:49.722" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:53:19.822" grpc.time_ms=0.473 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2252gitlab # [ 248.980245] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.934Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"9c12bc70c6fa1cf9313182a3","created_at":"2026-08-20T08:53:19.700Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-795c6b4919d34034","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:19.702Z","job_size_bytes":23,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-9c12bc70c6fa1cf9313182a3: done: 0.024294 sec","job_status":"done","queue_duration_s":0.207784,"scheduling_latency_s":0.207798,"redis_calls":7,"redis_duration_s":0.0011870000000000001,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000677,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00051,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017539,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024294,"completed_at":"2026-08-20T08:53:19.934Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003937,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2253gitlab # [ 248.996259] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.934Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"95668d38902caeba0c7a89fc","created_at":"2026-08-20T08:53:19.773Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-795c6b4919d34034","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:19.776Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-95668d38902caeba0c7a89fc: start","job_status":"start","queue_duration_s":0.158945,"scheduling_latency_s":0.15896}2254gitlab # [ 249.009670] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.951Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"95668d38902caeba0c7a89fc","created_at":"2026-08-20T08:53:19.773Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-795c6b4919d34034","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:19.776Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-95668d38902caeba0c7a89fc: done: 0.016585 sec","job_status":"done","queue_duration_s":0.158945,"scheduling_latency_s":0.15896,"redis_calls":7,"redis_duration_s":0.0008910000000000001,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000652,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000239,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011129,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016585,"completed_at":"2026-08-20T08:53:19.951Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002295,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2255gitlab # [ 249.043907] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.952Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"674812e92a9802994e4a4d83","created_at":"2026-08-20T08:53:19.779Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-795c6b4919d34034","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:19.780Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-674812e92a9802994e4a4d83: start","job_status":"start","queue_duration_s":0.172088,"scheduling_latency_s":0.172101}2256gitlab # [ 249.055984] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.969Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"674812e92a9802994e4a4d83","created_at":"2026-08-20T08:53:19.779Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-795c6b4919d34034","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:19.780Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-674812e92a9802994e4a4d83: done: 0.017382 sec","job_status":"done","queue_duration_s":0.172088,"scheduling_latency_s":0.172101,"redis_calls":7,"redis_duration_s":0.0008749999999999999,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000627,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000248,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012208,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017382,"completed_at":"2026-08-20T08:53:19.969Z","load_balancing_strategy":"primary","db_duration_s":0.002614,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2257gitlab # [ 249.090115] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.970Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"f3a9995999c7abda200286b4","created_at":"2026-08-20T08:53:19.785Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-795c6b4919d34034","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:19.786Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-f3a9995999c7abda200286b4: start","job_status":"start","queue_duration_s":0.184494,"scheduling_latency_s":0.184509}2258gitlab # [ 249.132146] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.993Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"f3a9995999c7abda200286b4","created_at":"2026-08-20T08:53:19.785Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-795c6b4919d34034","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:19.786Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-f3a9995999c7abda200286b4: done: 0.022903 sec","job_status":"done","queue_duration_s":0.184494,"scheduling_latency_s":0.184509,"redis_calls":10,"redis_duration_s":0.001351,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000662,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000445,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000244,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017011,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022903,"completed_at":"2026-08-20T08:53:19.993Z","load_balancing_strategy":"primary","db_duration_s":0.002919,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2259gitlab # [ 249.136900] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:19.995Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"5577fa3ec01df29d07023866","created_at":"2026-08-20T08:53:19.786Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-795c6b4919d34034","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:19.787Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-5577fa3ec01df29d07023866: start","job_status":"start","queue_duration_s":0.207657,"scheduling_latency_s":0.207678}2260gitlab # [ 249.181612] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:20.012Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"5577fa3ec01df29d07023866","created_at":"2026-08-20T08:53:19.786Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-795c6b4919d34034","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:19.787Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-5577fa3ec01df29d07023866: done: 0.017201 sec","job_status":"done","queue_duration_s":0.207657,"scheduling_latency_s":0.207678,"redis_calls":7,"redis_duration_s":0.000923,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000684,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000239,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011871,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017201,"completed_at":"2026-08-20T08:53:20.012Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002359,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2261gitlab # [ 249.184559] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:20.013Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"4bb6d58ed73da5d1d0ba1430","created_at":"2026-08-20T08:53:19.787Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-795c6b4919d34034","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:19.788Z","job_size_bytes":19,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-4bb6d58ed73da5d1d0ba1430: start","job_status":"start","queue_duration_s":0.224448,"scheduling_latency_s":0.224464}2262gitlab # [ 249.227745] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:20.028Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"4bb6d58ed73da5d1d0ba1430","created_at":"2026-08-20T08:53:19.787Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-795c6b4919d34034","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:19.788Z","job_size_bytes":19,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-4bb6d58ed73da5d1d0ba1430: done: 0.015346 sec","job_status":"done","queue_duration_s":0.224448,"scheduling_latency_s":0.224464,"redis_calls":8,"redis_duration_s":0.00101,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000755,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000255,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01048,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015346,"completed_at":"2026-08-20T08:53:20.028Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002149,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2263gitlab # [ 249.264550] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:20.029Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"39f91f12fdef0488cafb20a1","created_at":"2026-08-20T08:53:19.789Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-795c6b4919d34034","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:19.790Z","job_size_bytes":66,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-39f91f12fdef0488cafb20a1: start","job_status":"start","queue_duration_s":0.239096,"scheduling_latency_s":0.23911}2264gitlab # [ 249.265300] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:20.044Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"39f91f12fdef0488cafb20a1","created_at":"2026-08-20T08:53:19.789Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-795c6b4919d34034","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:19.790Z","job_size_bytes":66,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-39f91f12fdef0488cafb20a1: done: 0.015038 sec","job_status":"done","queue_duration_s":0.239096,"scheduling_latency_s":0.23911,"redis_calls":7,"redis_duration_s":0.000897,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000667,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00023,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010147,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015038,"completed_at":"2026-08-20T08:53:20.044Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001993,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2265gitlab # [ 249.279450] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:20.045Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"12adf05b9d2a45966ff7224b","created_at":"2026-08-20T08:53:19.791Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-795c6b4919d34034","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:19.792Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-12adf05b9d2a45966ff7224b: start","job_status":"start","queue_duration_s":0.253538,"scheduling_latency_s":0.253552}2266gitlab # [ 249.292431] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:20.065Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"12adf05b9d2a45966ff7224b","created_at":"2026-08-20T08:53:19.791Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-795c6b4919d34034","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:19.792Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-12adf05b9d2a45966ff7224b: done: 0.019955 sec","job_status":"done","queue_duration_s":0.253538,"scheduling_latency_s":0.253552,"redis_calls":7,"redis_duration_s":0.000935,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000694,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000241,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014726,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019955,"completed_at":"2026-08-20T08:53:20.065Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002716,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2267gitlab # [ 249.334810] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:20.066Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"7f8eb00ef74f10de6d27e81a","created_at":"2026-08-20T08:53:19.794Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-795c6b4919d34034","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:19.795Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-7f8eb00ef74f10de6d27e81a: start","job_status":"start","queue_duration_s":0.271436,"scheduling_latency_s":0.271449}2268gitlab # [ 249.338582] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:20.082Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"7f8eb00ef74f10de6d27e81a","created_at":"2026-08-20T08:53:19.794Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-795c6b4919d34034","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:19.795Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-7f8eb00ef74f10de6d27e81a: done: 0.015756 sec","job_status":"done","queue_duration_s":0.271436,"scheduling_latency_s":0.271449,"redis_calls":7,"redis_duration_s":0.000883,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000647,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000236,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009782,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015756,"completed_at":"2026-08-20T08:53:20.082Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003454,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2269gitlab # [ 249.403785] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:20.083Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"42a218345607e32eeae23914","created_at":"2026-08-20T08:53:19.795Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-795c6b4919d34034","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:19.796Z","job_size_bytes":6,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-42a218345607e32eeae23914: start","job_status":"start","queue_duration_s":0.28694,"scheduling_latency_s":0.286955}2270gitlab # [ 249.404587] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:20.091Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"42a218345607e32eeae23914","created_at":"2026-08-20T08:53:19.795Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-795c6b4919d34034","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:19.796Z","job_size_bytes":6,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-42a218345607e32eeae23914: done: 0.008529 sec","job_status":"done","queue_duration_s":0.28694,"scheduling_latency_s":0.286955,"redis_calls":7,"redis_duration_s":0.0008539999999999999,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000628,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000226,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005494,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008529,"completed_at":"2026-08-20T08:53:20.091Z","load_balancing_strategy":"primary","db_duration_s":0.000233,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2271gitlab # [ 249.439417] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:20.092Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"becbcc80e184faf6503a8e35","created_at":"2026-08-20T08:53:19.796Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-795c6b4919d34034","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:19.797Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-becbcc80e184faf6503a8e35: start","job_status":"start","queue_duration_s":0.29517,"scheduling_latency_s":0.295183}2272gitlab # [ 249.439981] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:20.106Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"becbcc80e184faf6503a8e35","created_at":"2026-08-20T08:53:19.796Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-795c6b4919d34034","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:19.797Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-becbcc80e184faf6503a8e35: done: 0.013817 sec","job_status":"done","queue_duration_s":0.29517,"scheduling_latency_s":0.295183,"redis_calls":7,"redis_duration_s":0.000852,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000621,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000231,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009534,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013817,"completed_at":"2026-08-20T08:53:20.106Z","load_balancing_strategy":"primary","db_duration_s":0.001806,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2273gitlab # [ 249.486075] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:20.107Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"4d16f36a924915576852cbd4","created_at":"2026-08-20T08:53:19.827Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-795c6b4919d34034","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:19.828Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-4d16f36a924915576852cbd4: start","job_status":"start","queue_duration_s":0.278719,"scheduling_latency_s":0.278732}2274gitlab # [ 249.486647] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:20.122Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"4d16f36a924915576852cbd4","created_at":"2026-08-20T08:53:19.827Z","trace_propagation_headers":{"sentry-trace":"1facbe8becf840e286c13c2d14a1cf73-795c6b4919d34034","baggage":"sentry-trace_id=1facbe8becf840e286c13c2d14a1cf73,sentry-release=Unknown"},"correlation_id":"01M0F5YB7EGS4WK7HWWG5MRVQC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:19.828Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-4d16f36a924915576852cbd4: done: 0.015466 sec","job_status":"done","queue_duration_s":0.278719,"scheduling_latency_s":0.278732,"redis_calls":8,"redis_duration_s":0.001002,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00078,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000222,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010657,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015466,"completed_at":"2026-08-20T08:53:20.122Z","load_balancing_strategy":"primary","db_duration_s":0.001997,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2275gitlab # [ 249.554391] nixbot[2605]: {"ts": "2026-08-20T08:53:20.842Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/9494aaa3888aca4a4baa3113363b88e142f740a7 \"HTTP/1.1 201 Created\""}2276gitlab # [ 249.560567] nixbot[2605]: INFO: ::ffff:127.0.0.1:41268 - "GET /api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 200 OK2277gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', in 1.38 seconds)2278(finished: subtest: push delivers the webhook, in 52.89 seconds)2279subtest: eval and build post commit statuses2280gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3/statuses2281gitlab # [ 249.602391] nix-daemon[2824]: accepted connection from pid 3404, user nixbot2282gitlab # [ 249.666807] nix-daemon[2824]: accepted connection from pid 3418, user nixbot2283gitlab # [ 249.668276] gitaly[920]: time="2026-08-20T08:53:20.957Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5ZXWKGT7FYTJ88H3SVGPB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:53:50.454" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:53:20.954" grpc.time_ms=2.061 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2284gitlab # [ 249.687093] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:53:20 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 602285gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3/statuses, in 0.10 seconds)2286gitlab # [ 249.705366] nix-daemon[2824]: accepted connection from pid 3404, user nixbot2287gitlab # [ 249.771831] gitaly[920]: time="2026-08-20T08:53:21.060Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5ZXZYQBSW8JHC3QQ8D734 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:53:51.059" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:53:21.059" grpc.time_ms=0.855 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2288gitlab # [ 249.834914] gitaly[920]: time="2026-08-20T08:53:21.123Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F5ZXZYQBSW8JHC3QQ8D734 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:53:31.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:53:21.111" grpc.time_ms=11.735 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2289gitlab # [ 249.864822] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:21.152Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"eaa710d369808ea7b3abc99e","created_at":"2026-08-20T08:53:21.146Z","trace_propagation_headers":{"sentry-trace":"e7bbdfdd5d1a4360b336977ccd3a5b0b-0fa514bcd3d243ce","baggage":"sentry-trace_id=e7bbdfdd5d1a4360b336977ccd3a5b0b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F5ZXZYQBSW8JHC3QQ8D734","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:21.150Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-eaa710d369808ea7b3abc99e: start","job_status":"start","queue_duration_s":0.00184,"scheduling_latency_s":0.00187}2290gitlab # [ 249.877320] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:53:21 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 1432291gitlab # [ 249.878888] nixbot[2605]: {"ts": "2026-08-20T08:53:21.167Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 \"HTTP/1.1 201 Created\""}2292gitlab # [ 249.921284] gitaly[920]: time="2026-08-20T08:53:21.210Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5ZY4M4C1WB4SQSPZT9A50 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:53:51.008" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:53:21.209" grpc.time_ms=0.664 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2293gitlab # [ 249.968833] gitaly[920]: time="2026-08-20T08:53:21.257Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0F5ZY4M4C1WB4SQSPZT9A50 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:53:31.141" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:53:21.251" grpc.time_ms=5.943 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2294gitlab # [ 250.010369] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:53:21 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1262295gitlab # [ 250.011356] nixbot[2605]: {"ts": "2026-08-20T08:53:21.300Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 \"HTTP/1.1 201 Created\""}2296gitlab # [ 250.023932] gitaly[920]: time="2026-08-20T08:53:21.313Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F5ZXZYQBSW8JHC3QQ8D734 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:53:21.312" grpc.time_ms=0.529 pid=920 span.kind=server system=grpc2297gitlab # [ 250.051892] gitaly[920]: time="2026-08-20T08:53:21.341Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F5ZXZYQBSW8JHC3QQ8D734 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3890 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:53:21.339" grpc.time_ms=1.427 pid=920 span.kind=server system=grpc2298gitlab # [ 250.054760] gitaly[920]: time="2026-08-20T08:53:21.343Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5ZY8XFNEQHF3HBNQYT8AP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:53:51.142" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:53:21.343" grpc.time_ms=0.472 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2299gitlab # [ 250.079668] gitaly[920]: time="2026-08-20T08:53:21.368Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0F5ZY8XFNEQHF3HBNQYT8AP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:53:31.252" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:53:21.362" grpc.time_ms=5.649 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2300gitlab # [ 250.097779] gitaly[920]: time="2026-08-20T08:53:21.386Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F5ZXZYQBSW8JHC3QQ8D734 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:53:21.386" grpc.time_ms=0.237 pid=920 span.kind=server system=grpc2301gitlab # [ 250.106793] gitaly[920]: time="2026-08-20T08:53:21.395Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5ZXZYQBSW8JHC3QQ8D734 forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T08:53:51.176" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:53:21.277" operations="[repack_refs]" pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2302gitlab # [ 250.110155] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:53:21 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 892303gitlab # [ 250.111191] nixbot[2605]: {"ts": "2026-08-20T08:53:21.400Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3 \"HTTP/1.1 201 Created\""}2304gitlab # [ 250.112461] gitaly[920]: time="2026-08-20T08:53:21.401Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5ZXZYQBSW8JHC3QQ8D734 diskcache=3c5e0ef6-851b-4d09-a2fb-1e69fdaa26f8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T08:53:51.176" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:53:21.277" pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2305gitlab # [ 250.113164] gitaly[920]: time="2026-08-20T08:53:21.401Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=100 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7367 command.oublock=0 command.real_time_ms=117 command.spawn_token_fork_ms=0 command.system_time_ms=58 command.user_time_ms=42 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5ZXZYQBSW8JHC3QQ8D734 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T08:53:51.176" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:53:21.277" grpc.time_ms=124.32 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2306gitlab # [ 250.139326] gitaly[920]: time="2026-08-20T08:53:21.428Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5ZXZYQBSW8JHC3QQ8D734 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T08:53:51.176" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:53:21.277" pid=920 remote_ip="2001:db8:1::1" repository_info="{false {6 703 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-08-20 08:52:22.677564166 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2307gitlab # [ 250.152631] gitaly[920]: time="2026-08-20T08:53:21.441Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5ZXZYQBSW8JHC3QQ8D734 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T08:53:51.176" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:53:21.277" pid=920 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2308gitlab # [ 250.153472] gitaly[920]: time="2026-08-20T08:53:21.441Z" level=info msg="optimized repository" clean_stale_data_time=12.977627ms clean_work_trees_time="67.327µs" commit_graph_time="3.352µs" correlation_id=01M0F5ZXZYQBSW8JHC3QQ8D734 gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="3.632µs" pid=920 prune_time="3.352µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="3.632µs" storage_name=default system=housekeeping total_time=13.156421ms2309gitlab # [ 250.154135] gitaly[920]: time="2026-08-20T08:53:21.442Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5ZXZYQBSW8JHC3QQ8D734 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T08:53:51.176" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:53:21.277" pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2310gitlab # [ 250.171323] nix-daemon[2824]: accepted connection from pid 3467, user nixbot2311gitlab # [ 250.196194] gitaly[920]: time="2026-08-20T08:53:21.485Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F5ZXZYQBSW8JHC3QQ8D734 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T08:53:51.384" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:53:21.484" grpc.time_ms=0.671 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2312gitlab # [ 250.227559] gitaly[920]: time="2026-08-20T08:53:21.516Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5ZXZYQBSW8JHC3QQ8D734 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:53:51.415" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:53:21.515" grpc.time_ms=0.542 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2313gitlab # [ 250.237327] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:21.526Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"e4289fd2824c4d0b44217ad6","created_at":"2026-08-20T08:53:21.524Z","trace_propagation_headers":{"sentry-trace":"e7bbdfdd5d1a4360b336977ccd3a5b0b-4e5e05debf7a4571","baggage":"sentry-trace_id=e7bbdfdd5d1a4360b336977ccd3a5b0b,sentry-release=Unknown"},"correlation_id":"01M0F5ZXZYQBSW8JHC3QQ8D734","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"eaa710d369808ea7b3abc99e","job_size_bytes":3,"pid":2557,"job_status":"deduplicated","message":"PipelineProcessWorker JID-e4289fd2824c4d0b44217ad6: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2314gitlab # [ 250.238643] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:21.527Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"eaa710d369808ea7b3abc99e","created_at":"2026-08-20T08:53:21.146Z","trace_propagation_headers":{"sentry-trace":"e7bbdfdd5d1a4360b336977ccd3a5b0b-0fa514bcd3d243ce","baggage":"sentry-trace_id=e7bbdfdd5d1a4360b336977ccd3a5b0b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F5ZXZYQBSW8JHC3QQ8D734","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:21.150Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2557,"job_status":"rescheduled","message":"PipelineProcessWorker JID-eaa710d369808ea7b3abc99e: rescheduled"}2315gitlab # [ 250.243857] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:21.532Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"eaa710d369808ea7b3abc99e","created_at":"2026-08-20T08:53:21.146Z","trace_propagation_headers":{"sentry-trace":"e7bbdfdd5d1a4360b336977ccd3a5b0b-0fa514bcd3d243ce","baggage":"sentry-trace_id=e7bbdfdd5d1a4360b336977ccd3a5b0b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F5ZXZYQBSW8JHC3QQ8D734","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:21.150Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-eaa710d369808ea7b3abc99e: done: 0.380903 sec","job_status":"done","queue_duration_s":0.00184,"scheduling_latency_s":0.00187,"gitaly_calls":3,"gitaly_duration_s":0.141412,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.025555,"redis_read_bytes":239,"redis_write_bytes":21779,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001213,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.00095,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.003155,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14464,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.016605,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.00037,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000375,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001674,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.008,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.012,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.016,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.128109,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.300651061,"duration_s":0.380903,"completed_at":"2026-08-20T08:53:21.532Z","load_balancing_strategy":"primary","db_duration_s":0.034864,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2316gitlab # [ 250.271283] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:21.538Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"2c4b54176e94ca3bf7ea84f4","created_at":"2026-08-20T08:53:21.270Z","trace_propagation_headers":{"sentry-trace":"e7bbdfdd5d1a4360b336977ccd3a5b0b-4e5e05debf7a4571","baggage":"sentry-trace_id=e7bbdfdd5d1a4360b336977ccd3a5b0b,sentry-release=Unknown"},"correlation_id":"01M0F5ZXZYQBSW8JHC3QQ8D734","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:21.272Z","job_size_bytes":23,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-2c4b54176e94ca3bf7ea84f4: start","job_status":"start","queue_duration_s":0.265879,"scheduling_latency_s":0.265898}2317gitlab # [ 250.280089] gitaly[920]: time="2026-08-20T08:53:21.562Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0F5ZYF1TEZJJPKDEBX164AQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:53:21.546" grpc.time_ms=14.734 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc2318gitlab # [ 250.290589] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:21.575Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"2c4b54176e94ca3bf7ea84f4","created_at":"2026-08-20T08:53:21.270Z","trace_propagation_headers":{"sentry-trace":"e7bbdfdd5d1a4360b336977ccd3a5b0b-4e5e05debf7a4571","baggage":"sentry-trace_id=e7bbdfdd5d1a4360b336977ccd3a5b0b,sentry-release=Unknown"},"correlation_id":"01M0F5ZXZYQBSW8JHC3QQ8D734","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:21.272Z","job_size_bytes":23,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-2c4b54176e94ca3bf7ea84f4: done: 0.036633 sec","job_status":"done","queue_duration_s":0.265879,"scheduling_latency_s":0.265898,"redis_calls":7,"redis_duration_s":0.003038,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001526,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001512,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.036633,"completed_at":"2026-08-20T08:53:21.575Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007557,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2319gitlab # [ 250.344356] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:21.576Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"0aede1cb7a9bcac40228e9d7","created_at":"2026-08-20T08:53:21.405Z","trace_propagation_headers":{"sentry-trace":"e7bbdfdd5d1a4360b336977ccd3a5b0b-4e5e05debf7a4571","baggage":"sentry-trace_id=e7bbdfdd5d1a4360b336977ccd3a5b0b,sentry-release=Unknown"},"correlation_id":"01M0F5ZXZYQBSW8JHC3QQ8D734","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:21.407Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-0aede1cb7a9bcac40228e9d7: start","job_status":"start","queue_duration_s":0.168508,"scheduling_latency_s":0.168528}2320gitlab # [ 250.344942] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:21.593Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"0aede1cb7a9bcac40228e9d7","created_at":"2026-08-20T08:53:21.405Z","trace_propagation_headers":{"sentry-trace":"e7bbdfdd5d1a4360b336977ccd3a5b0b-4e5e05debf7a4571","baggage":"sentry-trace_id=e7bbdfdd5d1a4360b336977ccd3a5b0b,sentry-release=Unknown"},"correlation_id":"01M0F5ZXZYQBSW8JHC3QQ8D734","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:21.407Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-0aede1cb7a9bcac40228e9d7: done: 0.016852 sec","job_status":"done","queue_duration_s":0.168508,"scheduling_latency_s":0.168528,"redis_calls":7,"redis_duration_s":0.00098,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000654,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000326,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011239,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016852,"completed_at":"2026-08-20T08:53:21.593Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00252,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2321gitlab # [ 250.381778] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:21.594Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"ae2f3693c695fc96bb4a122b","created_at":"2026-08-20T08:53:21.413Z","trace_propagation_headers":{"sentry-trace":"e7bbdfdd5d1a4360b336977ccd3a5b0b-4e5e05debf7a4571","baggage":"sentry-trace_id=e7bbdfdd5d1a4360b336977ccd3a5b0b,sentry-release=Unknown"},"correlation_id":"01M0F5ZXZYQBSW8JHC3QQ8D734","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:21.415Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-ae2f3693c695fc96bb4a122b: start","job_status":"start","queue_duration_s":0.178702,"scheduling_latency_s":0.178716}2322gitlab # [ 250.383691] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:53:21 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 952323gitlab # [ 250.386050] gitlab-workhorse[824]: time="2026-08-20T08:53:21Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672324gitlab # [ 250.386818] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/20:08:53:21 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 442325gitlab # [ 250.388501] gitaly[920]: time="2026-08-20T08:53:21.645Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5ZYJ2YNC7P9SB9T4J7FS0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:53:21.638" pid=920 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2326gitlab # [ 250.423661] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:21.615Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"ae2f3693c695fc96bb4a122b","created_at":"2026-08-20T08:53:21.413Z","trace_propagation_headers":{"sentry-trace":"e7bbdfdd5d1a4360b336977ccd3a5b0b-4e5e05debf7a4571","baggage":"sentry-trace_id=e7bbdfdd5d1a4360b336977ccd3a5b0b,sentry-release=Unknown"},"correlation_id":"01M0F5ZXZYQBSW8JHC3QQ8D734","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:21.415Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-ae2f3693c695fc96bb4a122b: done: 0.021582 sec","job_status":"done","queue_duration_s":0.178702,"scheduling_latency_s":0.178716,"redis_calls":7,"redis_duration_s":0.001007,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000726,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000281,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014604,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021582,"completed_at":"2026-08-20T08:53:21.615Z","load_balancing_strategy":"primary","db_duration_s":0.003807,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2327gitlab # [ 250.461569] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:21.616Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"141a028ab88204ce838994a3","created_at":"2026-08-20T08:53:21.420Z","trace_propagation_headers":{"sentry-trace":"e7bbdfdd5d1a4360b336977ccd3a5b0b-4e5e05debf7a4571","baggage":"sentry-trace_id=e7bbdfdd5d1a4360b336977ccd3a5b0b,sentry-release=Unknown"},"correlation_id":"01M0F5ZXZYQBSW8JHC3QQ8D734","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:21.422Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-141a028ab88204ce838994a3: start","job_status":"start","queue_duration_s":0.193795,"scheduling_latency_s":0.193815}2328gitlab # [ 250.462495] gitaly[920]: time="2026-08-20T08:53:21.646Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5ZYJ2YNC7P9SB9T4J7FS0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:53:21.638" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc2329gitlab # [ 250.463088] nix-daemon[2824]: accepted connection from pid 3496, user nixbot2330gitlab # [ 250.463499] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:21.635Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"141a028ab88204ce838994a3","created_at":"2026-08-20T08:53:21.420Z","trace_propagation_headers":{"sentry-trace":"e7bbdfdd5d1a4360b336977ccd3a5b0b-4e5e05debf7a4571","baggage":"sentry-trace_id=e7bbdfdd5d1a4360b336977ccd3a5b0b,sentry-release=Unknown"},"correlation_id":"01M0F5ZXZYQBSW8JHC3QQ8D734","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:21.422Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-141a028ab88204ce838994a3: done: 0.018626 sec","job_status":"done","queue_duration_s":0.193795,"scheduling_latency_s":0.193815,"redis_calls":10,"redis_duration_s":0.001371,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000715,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000353,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000303,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012894,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018626,"completed_at":"2026-08-20T08:53:21.635Z","load_balancing_strategy":"primary","db_duration_s":0.002757,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2331gitlab # [ 250.487207] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:21.636Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"d4e94de8235b8184f276f9ae","created_at":"2026-08-20T08:53:21.423Z","trace_propagation_headers":{"sentry-trace":"e7bbdfdd5d1a4360b336977ccd3a5b0b-4e5e05debf7a4571","baggage":"sentry-trace_id=e7bbdfdd5d1a4360b336977ccd3a5b0b,sentry-release=Unknown"},"correlation_id":"01M0F5ZXZYQBSW8JHC3QQ8D734","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:21.424Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-d4e94de8235b8184f276f9ae: start","job_status":"start","queue_duration_s":0.212249,"scheduling_latency_s":0.212263}2332gitlab # [ 250.500628] gitaly[920]: time="2026-08-20T08:53:21.646Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5ZYJ2YNC7P9SB9T4J7FS0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:53:21.638" grpc.time_ms=7.213 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc2333gitlab # [ 250.538948] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:21.681Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"d4e94de8235b8184f276f9ae","created_at":"2026-08-20T08:53:21.423Z","trace_propagation_headers":{"sentry-trace":"e7bbdfdd5d1a4360b336977ccd3a5b0b-4e5e05debf7a4571","baggage":"sentry-trace_id=e7bbdfdd5d1a4360b336977ccd3a5b0b,sentry-release=Unknown"},"correlation_id":"01M0F5ZXZYQBSW8JHC3QQ8D734","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:21.424Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-d4e94de8235b8184f276f9ae: done: 0.04485 sec","job_status":"done","queue_duration_s":0.212249,"scheduling_latency_s":0.212263,"redis_calls":7,"redis_duration_s":0.001595,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000854,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000741,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.021,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014086,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.04485,"completed_at":"2026-08-20T08:53:21.681Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025236,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2334gitlab # [ 250.545813] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:21.683Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"06afcc5fdabbf6216759835b","created_at":"2026-08-20T08:53:21.424Z","trace_propagation_headers":{"sentry-trace":"e7bbdfdd5d1a4360b336977ccd3a5b0b-4e5e05debf7a4571","baggage":"sentry-trace_id=e7bbdfdd5d1a4360b336977ccd3a5b0b,sentry-release=Unknown"},"correlation_id":"01M0F5ZXZYQBSW8JHC3QQ8D734","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:21.426Z","job_size_bytes":19,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-06afcc5fdabbf6216759835b: start","job_status":"start","queue_duration_s":0.257834,"scheduling_latency_s":0.257853}2335gitlab # [ 250.558917] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:21.699Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"06afcc5fdabbf6216759835b","created_at":"2026-08-20T08:53:21.424Z","trace_propagation_headers":{"sentry-trace":"e7bbdfdd5d1a4360b336977ccd3a5b0b-4e5e05debf7a4571","baggage":"sentry-trace_id=e7bbdfdd5d1a4360b336977ccd3a5b0b,sentry-release=Unknown"},"correlation_id":"01M0F5ZXZYQBSW8JHC3QQ8D734","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:21.426Z","job_size_bytes":19,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-06afcc5fdabbf6216759835b: done: 0.015753 sec","job_status":"done","queue_duration_s":0.257834,"scheduling_latency_s":0.257853,"redis_calls":8,"redis_duration_s":0.001216,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000916,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0003,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009472,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015753,"completed_at":"2026-08-20T08:53:21.699Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002932,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2336gitlab # [ 250.608164] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:21.700Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"68a0d358a5bbaaa3fbc3ac03","created_at":"2026-08-20T08:53:21.426Z","trace_propagation_headers":{"sentry-trace":"e7bbdfdd5d1a4360b336977ccd3a5b0b-4e5e05debf7a4571","baggage":"sentry-trace_id=e7bbdfdd5d1a4360b336977ccd3a5b0b,sentry-release=Unknown"},"correlation_id":"01M0F5ZXZYQBSW8JHC3QQ8D734","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:21.439Z","job_size_bytes":66,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-68a0d358a5bbaaa3fbc3ac03: start","job_status":"start","queue_duration_s":0.260609,"scheduling_latency_s":0.260623}2337gitlab # [ 250.608717] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:21.713Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"68a0d358a5bbaaa3fbc3ac03","created_at":"2026-08-20T08:53:21.426Z","trace_propagation_headers":{"sentry-trace":"e7bbdfdd5d1a4360b336977ccd3a5b0b-4e5e05debf7a4571","baggage":"sentry-trace_id=e7bbdfdd5d1a4360b336977ccd3a5b0b,sentry-release=Unknown"},"correlation_id":"01M0F5ZXZYQBSW8JHC3QQ8D734","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:21.439Z","job_size_bytes":66,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-68a0d358a5bbaaa3fbc3ac03: done: 0.013039 sec","job_status":"done","queue_duration_s":0.260609,"scheduling_latency_s":0.260623,"redis_calls":7,"redis_duration_s":0.000873,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000645,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000228,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008757,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013039,"completed_at":"2026-08-20T08:53:21.713Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001697,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2338gitlab # [ 250.644440] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:21.717Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"fc25c250fadadd8b187f07e5","created_at":"2026-08-20T08:53:21.441Z","trace_propagation_headers":{"sentry-trace":"e7bbdfdd5d1a4360b336977ccd3a5b0b-4e5e05debf7a4571","baggage":"sentry-trace_id=e7bbdfdd5d1a4360b336977ccd3a5b0b,sentry-release=Unknown"},"correlation_id":"01M0F5ZXZYQBSW8JHC3QQ8D734","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:21.467Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-fc25c250fadadd8b187f07e5: start","job_status":"start","queue_duration_s":0.250425,"scheduling_latency_s":0.25044}2339gitlab # [ 250.653620] gitaly[920]: time="2026-08-20T08:53:21.859Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F5ZXZYQBSW8JHC3QQ8D734 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:53:21.859" grpc.time_ms=0.247 pid=920 span.kind=server system=grpc2340gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3/statuses2341gitlab # [ 250.661383] gitaly[920]: time="2026-08-20T08:53:21.876Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F5ZXZYQBSW8JHC3QQ8D734 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3890 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:53:21.876" grpc.time_ms=0.197 pid=920 span.kind=server system=grpc2342gitlab # [ 250.668867] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:21.757Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"fc25c250fadadd8b187f07e5","created_at":"2026-08-20T08:53:21.441Z","trace_propagation_headers":{"sentry-trace":"e7bbdfdd5d1a4360b336977ccd3a5b0b-4e5e05debf7a4571","baggage":"sentry-trace_id=e7bbdfdd5d1a4360b336977ccd3a5b0b,sentry-release=Unknown"},"correlation_id":"01M0F5ZXZYQBSW8JHC3QQ8D734","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:21.467Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-fc25c250fadadd8b187f07e5: done: 0.040523 sec","job_status":"done","queue_duration_s":0.250425,"scheduling_latency_s":0.25044,"redis_calls":7,"redis_duration_s":0.001075,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000802,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000273,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017467,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040523,"completed_at":"2026-08-20T08:53:21.757Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.020513,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2343gitlab # [ 250.704219] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:21.760Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"2e795de6284fd53f96b8edc9","created_at":"2026-08-20T08:53:21.470Z","trace_propagation_headers":{"sentry-trace":"e7bbdfdd5d1a4360b336977ccd3a5b0b-4e5e05debf7a4571","baggage":"sentry-trace_id=e7bbdfdd5d1a4360b336977ccd3a5b0b,sentry-release=Unknown"},"correlation_id":"01M0F5ZXZYQBSW8JHC3QQ8D734","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:21.472Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-2e795de6284fd53f96b8edc9: start","job_status":"start","queue_duration_s":0.288104,"scheduling_latency_s":0.288128}2344gitlab # [ 250.748861] gitaly[920]: time="2026-08-20T08:53:21.894Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F5ZXZYQBSW8JHC3QQ8D734 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:53:21.894" grpc.time_ms=0.356 pid=920 span.kind=server system=grpc2345gitlab # [ 250.749528] gitaly[920]: time="2026-08-20T08:53:21.904Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0F5ZXZYQBSW8JHC3QQ8D734 diskcache=0c61909e-f615-499f-b93c-723d6348c981 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T08:53:51.740" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:53:21.840" pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2346gitlab # [ 250.750200] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:21.777Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"2e795de6284fd53f96b8edc9","created_at":"2026-08-20T08:53:21.470Z","trace_propagation_headers":{"sentry-trace":"e7bbdfdd5d1a4360b336977ccd3a5b0b-4e5e05debf7a4571","baggage":"sentry-trace_id=e7bbdfdd5d1a4360b336977ccd3a5b0b,sentry-release=Unknown"},"correlation_id":"01M0F5ZXZYQBSW8JHC3QQ8D734","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:21.472Z","job_size_bytes":3,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-2e795de6284fd53f96b8edc9: done: 0.016912 sec","job_status":"done","queue_duration_s":0.288104,"scheduling_latency_s":0.288128,"redis_calls":7,"redis_duration_s":0.0008810000000000001,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000633,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000248,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010498,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016912,"completed_at":"2026-08-20T08:53:21.777Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003547,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2347gitlab # [ 250.762877] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:21.778Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"22949aaa4e90ff3053cd424b","created_at":"2026-08-20T08:53:21.473Z","trace_propagation_headers":{"sentry-trace":"e7bbdfdd5d1a4360b336977ccd3a5b0b-4e5e05debf7a4571","baggage":"sentry-trace_id=e7bbdfdd5d1a4360b336977ccd3a5b0b,sentry-release=Unknown"},"correlation_id":"01M0F5ZXZYQBSW8JHC3QQ8D734","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:21.474Z","job_size_bytes":6,"pid":2557,"sidekiq_tid":"m7xl","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-22949aaa4e90ff3053cd424b: start","job_status":"start","queue_duration_s":0.303989,"scheduling_latency_s":0.304003}2348gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3/statuses, in 0.11 seconds)2349(finished: subtest: eval and build post commit statuses, in 1.22 seconds)2350(finished: run the VM test script, in 301.54 seconds)2351gitlab # [ 250.775732] gitaly[920]: time="2026-08-20T08:53:21.904Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=61 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7193 command.oublock=0 command.real_time_ms=56 command.spawn_token_fork_ms=0 command.system_time_ms=35 command.user_time_ms=26 component=gitaly.UnaryServerInterceptor correlation_id=01M0F5ZXZYQBSW8JHC3QQ8D734 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T08:53:51.740" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:53:21.840" grpc.time_ms=63.353 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2352test script finished in 301.56s2353cleanup2354kill QemuMachine (pid 46)2355gitlab # [ 250.786158] sidekiq-cluster[2557]: {"severity":"INFO","time":"2026-08-20T08:53:21.786Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"22949aaa4e90ff3053cd424b","created_at":"2026-08-20T08:53:21.473Z","trace_propagation_headers":{"sentry-trace":"e7bbdfdd5d1a4360b336977ccd3a5b0b-4e5e05debf7a4571","baggage":"sentry-trace_id=e7bbdfdd5d1a4360b336977ccd3a5b0b,sentry-release=Unknown"},"correlation_id":"01M0F5ZXZYQBSW8JHC3QQ8D734","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T08:53:21.474Z","job_size_bytesqemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14)2356gitlab # "2357(finished: cleanup, in 1.44 seconds)2358additionally exposed symbols:2359 gitlab,2360 vlan1,2361 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2362[]2363[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-20T08:52:27.539Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2364[]2365[]2366[]2367[]2368[]2369[]2370[]2371[]2372[]2373[]2374[]2375[]2376[]2377[]2378[]2379[]2380[]2381[]2382[]2383[]2384[]2385[]2386[]2387[]2388[]2389[]2390[]2391[]2392[]2393[]2394[]2395[]2396[]2397[]2398[]2399[]2400[]2401[]2402[]2403[]2404[]2405[]2406[]2407[]2408[]2409[]2410[]2411[]2412[]2413[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-20T08:53:19.049265Z', 'started_at': '2026-08-20T08:53:19.330371Z', 'finished_at': None}]2414[{'id': 5, 'sha': '361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-20T08:53:19.311Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2415[{'id': 5, 'sha': '361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded', 'created_at': '2026-08-20T08:53:19.311Z', 'started_at': None, 'finished_at': '2026-08-20T08:53:21.140Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '361c5ea7d2ec6e7c92b4d3ae515199445e77f6d3', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-08-20T08:53:21.282Z', 'started_at': None, 'finished_at': '2026-08-20T08:53:21.382Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]