vm-test-run-nixbot-gitlab
checks.x86_64-linux.nixbot-gitlab
· build #254
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.zdkJBL6lTk', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13gitlab # Discarding device blocks: 0/262144 done14gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes15gitlab # Filesystem UUID: ca0dd655-85f5-4985-9fb9-05ff1bfd270316gitlab # Superblock backups stored on blocks:17gitlab # 32768, 98304, 163840, 22937618gitlab # 19gitlab # Allocating group tables: 0/8 done20gitlab # Writing inode tables: 0/8 done21gitlab # Creating journal (8192 blocks): done22gitlab # Writing superblocks and filesystem accounting information: 0/8 done23gitlab # 24gitlab # Virtualisation disk image created.25gitlab # Creating Nix store image...26gitlab # Created Nix store image.27(finished: start all VMs, in 49.31 seconds)28gitlab: waiting for unit setup-gitlab.service29gitlab: waiting for the VM to finish booting30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 202645gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/cj5z4v0zgfanqqmxficm9ssay1jybbsl-nixos-system-gitlab-test/init regInfo=/nix/store/v2dxaicpbrv7c5mym6yag0bw9df2w4d4-closure-info/registration console=ttyS0,115200n8 console=tty046gitlab # [ 0.000000] BIOS-provided physical RAM map:47gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable48gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved49gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable51gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable55gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved56gitlab # [ 0.000000] NX (Execute Disable) protection: active57gitlab # [ 0.000000] APIC: Static calls initialized58gitlab # [ 0.000000] SMBIOS 2.8 present.59gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201460gitlab # [ 0.000000] DMI: Memory slots populated: 1/161gitlab # [ 0.000000] Hypervisor detected: KVM62gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000063gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0064gitlab # [ 0.000000] kvm-clock: using sched offset of 490497692 cycles65gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns66gitlab # [ 0.000005] tsc: Detected 2400.008 MHz processor67gitlab # [ 0.000808] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000068gitlab # [ 0.000835] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs69gitlab # [ 0.000837] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT70gitlab # [ 0.000874] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000071gitlab # [ 0.002727] found SMP MP-table at [mem 0x000f5470-0x000f547f]72gitlab # [ 0.002738] Using GB pages for direct mapping73gitlab # [ 0.002817] RAMDISK: [mem 0xbe31c000-0xbffcffff]74gitlab # [ 0.002825] ACPI: Early table checksum verification disabled75gitlab # [ 0.002827] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )76gitlab # [ 0.002831] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)77gitlab # [ 0.002835] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002841] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002843] ACPI: FACS 0x00000000BFFE0000 00004080gitlab # [ 0.002845] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)81gitlab # [ 0.002846] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002848] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002849] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]84gitlab # [ 0.002850] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]85gitlab # [ 0.002851] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]86gitlab # [ 0.002851] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]87gitlab # [ 0.002852] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]88gitlab # [ 0.002852] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]89gitlab # [ 0.003066] No NUMA configuration found90gitlab # [ 0.003067] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]91gitlab # [ 0.003069] NODE_DATA(0) allocated [mem 0x1bfff8780-0x1bfffdcff]92gitlab # [ 0.005395] Zone ranges:93gitlab # [ 0.005395] DMA [mem 0x0000000000001000-0x0000000000ffffff]94gitlab # [ 0.005397] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]95gitlab # [ 0.005398] Normal [mem 0x0000000100000000-0x00000001bfffffff]96gitlab # [ 0.005399] Device empty97gitlab # [ 0.005400] Movable zone start for each node98gitlab # [ 0.005400] Early memory node ranges99gitlab # [ 0.005401] node 0: [mem 0x0000000000001000-0x000000000009efff]100gitlab # [ 0.005402] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]101gitlab # [ 0.005403] node 0: [mem 0x0000000100000000-0x00000001bfffffff]102gitlab # [ 0.005404] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]103gitlab # [ 0.005422] On node 0, zone DMA: 1 pages in unavailable ranges104gitlab # [ 0.005691] On node 0, zone DMA: 97 pages in unavailable ranges105gitlab # [ 0.115770] On node 0, zone Normal: 40 pages in unavailable ranges106gitlab # [ 0.116184] ACPI: PM-Timer IO Port: 0x608107gitlab # [ 0.116198] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])108gitlab # [ 0.116230] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23109gitlab # [ 0.116232] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)110gitlab # [ 0.116234] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)111gitlab # [ 0.116235] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)112gitlab # [ 0.116236] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)113gitlab # [ 0.116237] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)114gitlab # [ 0.116240] ACPI: Using ACPI (MADT) for SMP configuration information115gitlab # [ 0.116241] ACPI: HPET id: 0x8086a201 base: 0xfed00000116gitlab # [ 0.116246] TSC deadline timer available117gitlab # [ 0.116250] CPU topo: Max. logical packages: 1118gitlab # [ 0.116251] CPU topo: Max. logical dies: 1119gitlab # [ 0.116251] CPU topo: Max. dies per package: 1120gitlab # [ 0.116254] CPU topo: Max. threads per core: 1121gitlab # [ 0.116255] CPU topo: Num. cores per package: 4122gitlab # [ 0.116256] CPU topo: Num. threads per package: 4123gitlab # [ 0.116256] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs124gitlab # [ 0.116279] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()125gitlab # [ 0.116295] kvm-guest: KVM setup pv remote TLB flush126gitlab # [ 0.116298] kvm-guest: setup PV sched yield127gitlab # [ 0.116318] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]128gitlab # [ 0.116319] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]129gitlab # [ 0.116320] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]130gitlab # [ 0.116322] [mem 0xc0000000-0xfeffbfff] available for PCI devices131gitlab # [ 0.116323] Booting paravirtualized kernel on KVM132gitlab # [ 0.116327] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns133gitlab # [ 0.120781] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1134gitlab # [ 0.123025] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288135gitlab # [ 0.123073] kvm-guest: PV spinlocks enabled136gitlab # [ 0.123075] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)137gitlab # [ 0.123078] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/cj5z4v0zgfanqqmxficm9ssay1jybbsl-nixos-system-gitlab-test/init regInfo=/nix/store/v2dxaicpbrv7c5mym6yag0bw9df2w4d4-closure-info/registration console=ttyS0,115200n8 console=tty0138gitlab # [ 0.123174] Unknown kernel command line parameters "regInfo=/nix/store/v2dxaicpbrv7c5mym6yag0bw9df2w4d4-closure-info/registration", will be passed to user space.139gitlab # [ 0.123187] random: crng init done140gitlab # [ 0.123188] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes141gitlab # [ 0.132117] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)142gitlab # [ 0.136461] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)143gitlab # [ 0.136536] software IO TLB: area num 4.144gitlab # [ 0.212014] Fallback order for Node 0: 0145gitlab # [ 0.212021] Built 1 zonelists, mobility grouping on. Total pages: 1572726146gitlab # [ 0.212023] Policy zone: Normal147gitlab # [ 0.214564] mem auto-init: stack:all(zero), heap alloc:on, heap free:off148gitlab # [ 0.224067] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1149gitlab # [ 0.237809] allocated 12582912 bytes of page_ext150gitlab # [ 0.248140] ftrace: allocating 48717 entries in 192 pages151gitlab # [ 0.248143] ftrace: allocated 192 pages with 2 groups152gitlab # [ 0.249006] Dynamic Preempt: lazy153gitlab # [ 0.249180] rcu: Preemptible hierarchical RCU implementation.154gitlab # [ 0.249181] rcu: RCU event tracing is enabled.155gitlab # [ 0.249181] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.156gitlab # [ 0.249183] Trampoline variant of Tasks RCU enabled.157gitlab # [ 0.249183] Rude variant of Tasks RCU enabled.158gitlab # [ 0.249184] Tracing variant of Tasks RCU enabled.159gitlab # [ 0.249184] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.160gitlab # [ 0.249185] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4161gitlab # [ 0.249206] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.162gitlab # [ 0.249207] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.249208] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.253569] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16165gitlab # [ 0.253859] rcu: srcu_init: Setting srcu_struct sizes based on contention.166gitlab # [ 0.253867] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns167gitlab # [ 0.253978] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)168gitlab # [ 0.257532] Console: colour VGA+ 80x25169gitlab # [ 0.257535] printk: legacy console [tty0] enabled170gitlab # [ 0.288416] printk: legacy console [ttyS0] enabled171gitlab # [ 0.386089] ACPI: Core revision 20250807172gitlab # [ 0.387043] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns173gitlab # [ 0.388534] APIC: Switch to symmetric I/O mode setup174gitlab # [ 0.389508] x2apic enabled175gitlab # [ 0.390270] APIC: Switched APIC routing to: physical x2apic176gitlab # [ 0.391165] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()177gitlab # [ 0.392347] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()178gitlab # [ 0.393786] kvm-guest: setup PV IPIs179gitlab # [ 0.395341] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1180gitlab # [ 0.396342] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns181gitlab # [ 0.398064] Calibrating delay loop (skipped) preset value.. 4800.01 BogoMIPS (lpj=2400008)182gitlab # [ 0.400102] x86/cpu: User Mode Instruction Prevention (UMIP) activated183gitlab # [ 0.401181] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127184gitlab # [ 0.402787] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0185gitlab # [ 0.403866] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto186gitlab # [ 0.405061] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl187gitlab # [ 0.406061] Transient Scheduler Attacks: Vulnerable: No microcode188gitlab # [ 0.407061] Spectre V2 : Mitigation: Enhanced / Automatic IBRS189gitlab # [ 0.408061] Speculative Return Stack Overflow: Mitigation: Safe RET190gitlab # [ 0.409060] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization191gitlab # [ 0.410068] Spectre V2 : Enabling IBPB for BPF192gitlab # [ 0.411062] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier193gitlab # [ 0.412062] active return thunk: srso_alias_return_thunk194gitlab # [ 0.413747] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'195gitlab # [ 0.415061] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'196gitlab # [ 0.416061] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'197gitlab # [ 0.417061] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'198gitlab # [ 0.418060] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'199gitlab # [ 0.419061] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'200gitlab # [ 0.420061] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'201gitlab # [ 0.421061] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256202gitlab # [ 0.422850] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64203gitlab # [ 0.423854] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512204gitlab # [ 0.424829] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024205gitlab # [ 0.425829] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8206gitlab # [ 0.426838] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.207gitlab # [ 0.456692] Freeing SMP alternatives memory: 44K208gitlab # [ 0.457064] pid_max: default: 32768 minimum: 301209gitlab # [ 0.458167] LSM: initializing lsm=capability,landlock,yama,bpf,ima210gitlab # [ 0.459154] landlock: Up and running.211gitlab # [ 0.460061] Yama: becoming mindful.212gitlab # [ 0.461098] LSM support for eBPF active213gitlab # [ 0.462015] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)214gitlab # [ 0.463209] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)215gitlab # [ 0.465977] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)216gitlab # [ 0.466633] Performance Events: Fam17h+ core perfctr, AMD PMU driver.217gitlab # [ 0.467066] ... version: 2218gitlab # [ 0.467801] ... bit width: 48219gitlab # [ 0.468064] ... generic counters: 6220gitlab # [ 0.468824] ... generic bitmap: 000000000000003f221gitlab # [ 0.469074] ... fixed-purpose counters: 0222gitlab # [ 0.469838] ... fixed-purpose bitmap: 0000000000000000223gitlab # [ 0.470063] ... value mask: 0000ffffffffffff224gitlab # [ 0.470988] ... max period: 00007fffffffffff225gitlab # [ 0.471769] ... global_ctrl mask: 000000000000003f226gitlab # [ 0.472190] signal: max sigframe size: 3376227gitlab # [ 0.472978] rcu: Hierarchical SRCU implementation.228gitlab # [ 0.473704] rcu: Max phase no-delay instances is 400.229gitlab # [ 0.474254] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level230gitlab # [ 0.479639] smp: Bringing up secondary CPUs ...231gitlab # [ 0.480512] smpboot: x86: Booting SMP configuration:232gitlab # [ 0.481066] .... node #0, CPUs: #1 #2 #3233gitlab # [ 0.484205] smp: Brought up 1 node, 4 CPUs234gitlab # [ 0.485787] smpboot: Total of 4 processors activated (19200.06 BogoMIPS)235gitlab # [ 0.486582] Memory: 6011596K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260108K reserved, 0K cma-reserved)236gitlab # [ 0.488063] devtmpfs: initialized237gitlab # [ 0.488864] x86/mm: Memory block size: 128MB238gitlab # [ 0.492242] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)239gitlab # [ 0.494128] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).240gitlab # [ 0.495169] pinctrl core: initialized pinctrl subsystem241gitlab # [ 0.496360] PM: RTC time: 07:10:06, date: 2026-08-23242gitlab # [ 0.500325] NET: Registered PF_NETLINK/PF_ROUTE protocol family243gitlab # [ 0.502776] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations244gitlab # [ 0.503119] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations245gitlab # [ 0.505181] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations246gitlab # [ 0.506074] audit: initializing netlink subsys (disabled)247gitlab # [ 0.507149] audit: type=2000 audit(1787469006.245:1): state=initialized audit_enabled=0 res=1248gitlab # [ 0.507315] thermal_sys: Registered thermal governor 'fair_share'249gitlab # [ 0.509064] thermal_sys: Registered thermal governor 'bang_bang'250gitlab # [ 0.510063] thermal_sys: Registered thermal governor 'step_wise'251gitlab # [ 0.511063] thermal_sys: Registered thermal governor 'user_space'252gitlab # [ 0.512050] thermal_sys: Registered thermal governor 'power_allocator'253gitlab # [ 0.512873] cpuidle: using governor menu254gitlab # [ 0.515289] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5255gitlab # [ 0.516337] PCI: Using configuration type 1 for base access256gitlab # [ 0.517065] PCI: Using configuration type 1 for extended access257gitlab # [ 0.518214] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.258gitlab # [ 0.520330] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages259gitlab # [ 0.521064] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page260gitlab # [ 0.522064] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages261gitlab # [ 0.523065] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page262gitlab # [ 0.528340] ACPI: Added _OSI(Module Device)263gitlab # [ 0.530072] ACPI: Added _OSI(Processor Device)264gitlab # [ 0.532072] ACPI: Added _OSI(Processor Aggregator Device)265gitlab # [ 0.539039] ACPI: 1 ACPI AML tables successfully acquired and loaded266gitlab # [ 0.545211] ACPI: Interpreter enabled267gitlab # [ 0.547158] ACPI: PM: (supports S0 S3 S4 S5)268gitlab # [ 0.549071] ACPI: Using IOAPIC for interrupt routing269gitlab # [ 0.551283] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug270gitlab # [ 0.554068] PCI: Using E820 reservations for host bridge windows271gitlab # [ 0.556537] ACPI: Enabled 2 GPEs in block 00 to 0F272gitlab # [ 0.570031] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])273gitlab # [ 0.572076] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]274gitlab # [ 0.575112] acpiphp: Slot [3] registered275gitlab # [ 0.577125] acpiphp: Slot [4] registered276gitlab # [ 0.578109] acpiphp: Slot [5] registered277gitlab # [ 0.579106] acpiphp: Slot [6] registered278gitlab # [ 0.581106] acpiphp: Slot [7] registered279gitlab # [ 0.582125] acpiphp: Slot [8] registered280gitlab # [ 0.583107] acpiphp: Slot [9] registered281gitlab # [ 0.585106] acpiphp: Slot [10] registered282gitlab # [ 0.586105] acpiphp: Slot [11] registered283gitlab # [ 0.587125] acpiphp: Slot [12] registered284gitlab # [ 0.589107] acpiphp: Slot [13] registered285gitlab # [ 0.590084] acpiphp: Slot [14] registered286gitlab # [ 0.590824] acpiphp: Slot [15] registered287gitlab # [ 0.591093] acpiphp: Slot [16] registered288gitlab # [ 0.591813] acpiphp: Slot [17] registered289gitlab # [ 0.593083] acpiphp: Slot [18] registered290gitlab # [ 0.593835] acpiphp: Slot [19] registered291gitlab # [ 0.594104] acpiphp: Slot [20] registered292gitlab # [ 0.594817] acpiphp: Slot [21] registered293gitlab # [ 0.595084] acpiphp: Slot [22] registered294gitlab # [ 0.595857] acpiphp: Slot [23] registered295gitlab # [ 0.597084] acpiphp: Slot [24] registered296gitlab # [ 0.597799] acpiphp: Slot [25] registered297gitlab # [ 0.598083] acpiphp: Slot [26] registered298gitlab # [ 0.598841] acpiphp: Slot [27] registered299gitlab # [ 0.600113] acpiphp: Slot [28] registered300gitlab # [ 0.600821] acpiphp: Slot [29] registered301gitlab # [ 0.601083] acpiphp: Slot [30] registered302gitlab # [ 0.601838] acpiphp: Slot [31] registered303gitlab # [ 0.603077] PCI host bridge to bus 0000:00304gitlab # [ 0.603822] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]305gitlab # [ 0.605064] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]306gitlab # [ 0.606069] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]307gitlab # [ 0.607111] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]308gitlab # [ 0.608068] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]309gitlab # [ 0.611097] pci_bus 0000:00: root bus resource [bus 00-ff]310gitlab # [ 0.614055] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint311gitlab # [ 0.618543] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint312gitlab # [ 0.623141] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint313gitlab # [ 0.630186] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]314gitlab # [ 0.632136] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk315gitlab # [ 0.634070] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk316gitlab # [ 0.637070] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk317gitlab # [ 0.639068] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk318gitlab # [ 0.642525] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint319gitlab # [ 0.647131] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]320gitlab # [ 0.651044] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint321gitlab # [ 0.654576] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI322gitlab # [ 0.656078] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB323gitlab # [ 0.659491] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint324gitlab # [ 0.675150] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]325gitlab # [ 0.676153] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]326gitlab # [ 0.678124] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]327gitlab # [ 0.681870] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]328gitlab # [ 0.687419] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint329gitlab # [ 0.698109] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]330gitlab # [ 0.700085] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]331gitlab # [ 0.702123] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]332gitlab # [ 0.732083] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]333gitlab # [ 0.736038] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint334gitlab # [ 0.745107] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]335gitlab # [ 0.745992] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]336gitlab # [ 0.746038] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]337gitlab # [ 0.749618] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint338gitlab # [ 0.759089] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]339gitlab # [ 0.761085] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]340gitlab # [ 0.764124] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]341gitlab # [ 0.770135] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint342gitlab # [ 0.780108] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]343gitlab # [ 0.782085] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]344gitlab # [ 0.784135] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]345gitlab # [ 0.789580] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint346gitlab # [ 0.797082] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]347gitlab # [ 0.799080] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]348gitlab # [ 0.801109] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]349gitlab # [ 0.804307] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint350gitlab # [ 0.807669] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]351gitlab # [ 0.809094] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]352gitlab # [ 0.810119] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]353gitlab # [ 0.812575] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint354gitlab # [ 0.817098] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]355gitlab # [ 0.819091] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]356gitlab # [ 0.820085] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]357gitlab # [ 0.821069] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]358gitlab # [ 0.823316] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint359gitlab # [ 0.826101] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]360gitlab # [ 0.827086] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]361gitlab # [ 0.830822] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint362gitlab # [ 0.835114] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]363gitlab # [ 0.836009] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]364gitlab # [ 0.836874] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]365gitlab # [ 0.839220] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint366gitlab # [ 0.842100] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]367gitlab # [ 0.843009] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]368gitlab # [ 0.844839] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]369gitlab # [ 0.849775] ACPI: PCI: Interrupt link LNKA configured for IRQ 10370gitlab # [ 0.851224] ACPI: PCI: Interrupt link LNKB configured for IRQ 10371gitlab # [ 0.852197] ACPI: PCI: Interrupt link LNKC configured for IRQ 11372gitlab # [ 0.853195] ACPI: PCI: Interrupt link LNKD configured for IRQ 11373gitlab # [ 0.854137] ACPI: PCI: Interrupt link LNKS configured for IRQ 9374gitlab # [ 0.857293] iommu: Default domain type: Translated375gitlab # [ 0.858695] iommu: DMA domain TLB invalidation policy: lazy mode376gitlab # [ 0.859303] ACPI: bus type USB registered377gitlab # [ 0.861145] usbcore: registered new interface driver usbfs378gitlab # [ 0.862088] usbcore: registered new interface driver hub379gitlab # [ 0.863026] usbcore: registered new device driver usb380gitlab # [ 0.864990] NetLabel: Initializing381gitlab # [ 0.865499] NetLabel: domain hash size = 128382gitlab # [ 0.866063] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO383gitlab # [ 0.867091] NetLabel: unlabeled traffic allowed by default384gitlab # [ 0.868028] PCI: Using ACPI for IRQ routing385gitlab # [ 0.869338] pci 0000:00:02.0: vgaarb: setting as boot VGA device386gitlab # [ 0.870060] pci 0000:00:02.0: vgaarb: bridge control possible387gitlab # [ 0.870060] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none388gitlab # [ 0.873066] vgaarb: loaded389gitlab # [ 0.873811] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0390gitlab # [ 0.874063] hpet0: 3 comparators, 64-bit 100.000000 MHz counter391gitlab # [ 0.879147] clocksource: Switched to clocksource kvm-clock392gitlab # [ 0.880714] VFS: Disk quotas dquot_6.6.0393gitlab # [ 0.881467] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)394gitlab # [ 0.883778] pnp: PnP ACPI init395gitlab # [ 0.886744] pnp: PnP ACPI: found 6 devices396gitlab # [ 0.900848] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns397gitlab # [ 0.902430] clocksource: Switched to clocksource acpi_pm398gitlab # [ 0.903445] NET: Registered PF_INET protocol family399gitlab # [ 0.905958] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)400gitlab # [ 0.923904] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)401gitlab # [ 0.925482] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)402gitlab # [ 0.926993] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)403gitlab # [ 0.936846] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)404gitlab # [ 0.940396] TCP: Hash tables configured (established 65536 bind 65536)405gitlab # [ 0.943884] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)406gitlab # [ 0.947051] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)407gitlab # [ 0.950443] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)408gitlab # [ 0.953773] NET: Registered PF_UNIX/PF_LOCAL protocol family409gitlab # [ 0.956252] NET: Registered PF_XDP protocol family410gitlab # [ 0.958311] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]411gitlab # [ 0.960776] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]412gitlab # [ 0.963242] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]413gitlab # [ 0.965853] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]414gitlab # [ 0.968507] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]415gitlab # [ 0.971688] pci 0000:00:01.0: PIIX3: Enabling Passive Release416gitlab # [ 0.974111] pci 0000:00:00.0: Limiting direct PCI/PCI transfers417gitlab # [ 0.979855] ACPI: \_SB_.LNKD: Enabled at IRQ 11418gitlab # [ 0.985071] PCI: CLS 0 bytes, default 64419gitlab # [ 0.986570] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)420gitlab # [ 0.986909] Trying to unpack rootfs image as initramfs...421gitlab # [ 0.987277] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB)422gitlab # [ 0.993543] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns423gitlab # [ 1.038554] Initialise system trusted keyrings424gitlab # [ 1.039773] workingset: timestamp_bits=40 max_order=21 bucket_order=0425gitlab # [ 1.051561] Key type asymmetric registered426gitlab # [ 1.052322] Asymmetric key parser 'x509' registered427gitlab # [ 1.053264] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)428gitlab # [ 1.054976] io scheduler mq-deadline registered429gitlab # [ 1.055779] io scheduler kyber registered430gitlab # [ 1.059836] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled431gitlab # [ 1.061152] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A432gitlab # [ 1.063799] Linux agpgart interface v0.103433gitlab # [ 1.064583] ACPI: bus type drm_connector registered434gitlab # [ 1.067085] usbcore: registered new interface driver usbserial_generic435gitlab # [ 1.068181] usbserial: USB Serial support registered for generic436gitlab # [ 1.069222] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.437gitlab # [ 1.069222] Please enable it if your BIOS has the CPPC option.438gitlab # [ 1.071533] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled439gitlab # [ 1.072936] drop_monitor: Initializing network drop monitor service440gitlab # [ 1.074151] NET: Registered PF_INET6 protocol family441gitlab # [ 1.076145] Segment Routing with IPv6442gitlab # [ 1.076892] In-situ OAM (IOAM) with IPv6443gitlab # [ 1.079803] IPI shorthand broadcast: enabled444gitlab # [ 1.084254] sched_clock: Marking stable (948010596, 136193670)->(1106777170, -22572904)445gitlab # [ 1.086019] registered taskstats version 1446gitlab # [ 1.086992] Loading compiled-in X.509 certificates447gitlab # [ 1.097094] Demotion targets for Node 0: null448gitlab # [ 1.098154] Key type .fscrypt registered449gitlab # [ 1.098850] Key type fscrypt-provisioning registered450gitlab # [ 1.099802] ima: No TPM chip found, activating TPM-bypass!451gitlab # [ 1.100729] ima: Allocated hash algorithm: sha1452gitlab # [ 1.101579] ima: No architecture policies found453gitlab # [ 1.102638] PM: Magic number: 6:99:168454gitlab # [ 1.104262] RAS: Correctable Errors collector initialized.455gitlab # [ 1.108696] clk: Disabling unused clocks456gitlab # [ 1.109442] PM: genpd: Disabling unused power domains457gitlab # [ 1.251139] Freeing initrd memory: 29392K458gitlab # [ 1.254784] Freeing unused decrypted memory: 2028K459gitlab # [ 1.257554] Freeing unused kernel image (initmem) memory: 3640K460gitlab # [ 1.258672] Write protecting the kernel read-only data: 32768k461gitlab # [ 1.260790] Freeing unused kernel image (text/rodata gap) memory: 1220K462gitlab # [ 1.262476] Freeing unused kernel image (rodata/data gap) memory: 760K463gitlab # [ 1.313869] x86/mm: Checked W+X mappings: passed, no W+X pages found.464gitlab # [ 1.314986] Run /init as init process465gitlab # [ 1.328160] systemd[1]: Inserted module 'autofs4'466gitlab # [ 1.350770] fuse: init (API version 7.45)467gitlab # [ 1.359561] ACPI: \_SB_.LNKC: Enabled at IRQ 10468gitlab # [ 1.365869] ACPI: \_SB_.LNKA: Enabled at IRQ 10469gitlab # [ 1.369236] ACPI: \_SB_.LNKB: Enabled at IRQ 11470gitlab # [ 1.407422] systemd[1]: Successfully made /usr/ read-only.471gitlab # [ 1.744158] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)472gitlab # [ 1.784919] systemd[1]: Detected virtualization kvm.473gitlab # [ 1.787063] systemd[1]: Detected architecture x86-64.474gitlab # [ 1.789255] systemd[1]: Running in initrd.475gitlab # [ 1.791676] systemd[1]: Initializing machine ID from random generator.476gitlab # [ 1.794276] systemd[1]: Hostname set to <gitlab>.477gitlab # [ 1.923727] systemd[1]: bpf-restrict-fs: LSM BPF program attached478gitlab # [ 1.970567] systemd[1]: Queued start job for default target Initrd Default Target.479gitlab # [ 1.978932] systemd[1]: Created slice Slice /system/modprobe.480gitlab # [ 1.980156] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.481gitlab # [ 1.981693] systemd[1]: Expecting device /dev/disk/by-label/nix-store...482gitlab # [ 1.982965] systemd[1]: Expecting device /dev/disk/by-label/nixos...483gitlab # [ 1.984154] systemd[1]: Reached target Path Units.484gitlab # [ 1.985127] systemd[1]: Reached target Slice Units.485gitlab # [ 1.986119] systemd[1]: Reached target Swaps.486gitlab # [ 1.986987] systemd[1]: Reached target Timer Units.487gitlab # [ 1.988126] systemd[1]: Listening on D-Bus System Message Bus Socket.488gitlab # [ 1.989438] systemd[1]: Listening on Journal Socket (/dev/log).489gitlab # [ 1.990601] systemd[1]: Listening on Journal Sockets.490gitlab # [ 1.991640] systemd[1]: Listening on udev Control Socket.491gitlab # [ 1.992655] systemd[1]: Listening on udev Kernel Socket.492gitlab # [ 1.993644] systemd[1]: Reached target Socket Units.493gitlab # [ 1.995637] systemd[1]: Starting Create List of Static Device Nodes...494gitlab # [ 1.997889] systemd[1]: Starting Load Kernel Module 9pnet_virtio...495gitlab # [ 2.000070] systemd[1]: Starting Load Kernel Module configfs...496gitlab # [ 2.002981] systemd[1]: Starting Journal Service...497gitlab # [ 2.006293] systemd[1]: Starting Load Kernel Modules...498gitlab # [ 2.010004] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os499gitlab # [ 2.016447] systemd[1]: Starting Coldplug All udev Devices...500gitlab # [ 2.028627] systemd[1]: Finished Create List of Static Device Nodes.501gitlab # [ 2.029510] systemd-journald[91]: Collecting audit messages is disabled.502gitlab # [ 2.036572] systemd[1]: modprobe@configfs.service: Deactivated successfully.503gitlab # [ 2.043566] systemd[1]: Finished Load Kernel Module configfs.504gitlab # [ 2.046816] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config505gitlab # [ 2.061374] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...506gitlab # [ 2.064968] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.507gitlab # [ 2.067281] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev508gitlab # [ 2.068229] netfs: FS-Cache loaded509gitlab # [ 2.077750] 9pnet: Installing 9P2000 support510gitlab # [ 2.077771] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.511gitlab # [ 2.080603] systemd[1]: Finished Load Kernel Modules.512gitlab # [ 2.083305] systemd[1]: Starting Apply Kernel Variables...513gitlab # [ 2.085167] systemd[1]: Starting Create Static Device Nodes in /dev...514gitlab # [ 2.087971] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.515gitlab # [ 2.090547] systemd[1]: Finished Load Kernel Module 9pnet_virtio.516gitlab # [ 1.955455] systemd-modules-l[ 2.091857] systemd[1]: Started Journal Service.517gitlab # oad[92]: Using 4 probe threads518gitlab # [ 1.957115] systemd-modules-load[92]: Inserted module 'virtio_balloon'519gitlab # [ 1.958182] systemd-modules-load[92]: Inserted module 'dm_mod'520gitlab # [ 1.960711] systemd-modules-load[92]: Inserted module 'virtio_gpu'521gitlab # [ 1.963094] systemd[1]: Finished Create Static Device Nodes in /dev.522gitlab # [ 1.965212] systemd[1]: Finished Apply Kernel Variables.523gitlab # [ 1.966648] systemd[1]: Reached target Preparation for Local File Systems.524gitlab # [ 1.967637] systemd[1]: Reached target Local File Systems.525gitlab # [ 1.968401] systemd[1]: Starting Create System Files and Directories...526gitlab # [ 1.969323] systemd[1]: Starting Rule-based Manager for Device Events and Files...527gitlab # [ 1.982492] systemd[1]: Finished Create System Files and Directories.528gitlab # [ 1.993859] systemd-udevd[112]: Using default interface naming scheme 'v261'.529gitlab # [ 2.004734] systemd[1]: Started Rule-based Manager for Device Events and Files.530gitlab # [ 2.056723] systemd[1]: Finished Coldplug All udev Devices.531gitlab # [ 2.057815] systemd[1]: Reached target System Initialization.532gitlab # [ 2.058844] systemd[1]: Reached target Basic System.533gitlab # [ 2.274511] uhci_hcd 0000:00:01.2: UHCI Host Controller534gitlab # [ 2.275370] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1535gitlab # [ 2.276656] uhci_hcd 0000:00:01.2: detected 2 ports536gitlab # [ 2.279461] virtio_blk virtio4: 4/0/0 default/read/poll queues537gitlab # [ 2.282934] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140538gitlab # [ 2.284170] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18539gitlab # [ 2.285458] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1540gitlab # [ 2.286499] usb usb1: Product: UHCI Host Controller541gitlab # [ 2.287213] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd542gitlab # [ 2.287907] usb usb1: SerialNumber: 0000:00:01.2543gitlab # [ 2.291384] SCSI subsystem initialized544gitlab # [ 2.291467] hub 1-0:1.0: USB hub found545gitlab # [ 2.292602] hub 1-0:1.0: 2 ports detected546gitlab # [ 2.295501] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)547gitlab # [ 2.303619] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12548gitlab # [ 2.306392] serio: i8042 KBD port at 0x60,0x64 irq 1549gitlab # [ 2.307093] serio: i8042 AUX port at 0x60,0x64 irq 12550gitlab # [ 2.314690] virtio_blk virtio5: 4/0/0 default/read/poll queues551gitlab # [ 2.333750] virtio_blk virtio5: [vdb] 11830872 512-byte logical blocks (6.06 GB/5.64 GiB)552gitlab # [ 2.343754] scsi host0: ata_piix553gitlab # [ 2.345438] scsi host1: ata_piix554gitlab # [ 2.346041] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0555gitlab # [ 2.347103] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0556gitlab # [ 2.219368] (udev-worker)[130]: Network interface NamePolicy= disabled on kernel command line.557gitlab # [ 2.222480] (udev-worker)[119]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.558gitlab # [ 2.224652] (udev-worker)[119]: Network interface NamePolicy= disabled on kernel command line.559gitlab # [ 2.231641] systemd[1]: Starting Virtual Console Setup...560gitlab # [ 2.238882] systemd[1]: Found device /dev/disk/by-label/nixos.561gitlab # [ 2.242134] systemd[1]: Found device /dev/disk/by-label/nix-store.562gitlab # [ 2.243035] systemd[1]: Reached target Initrd Root Device.563gitlab # [ 2.244386] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...564gitlab # [ 2.253272] systemd-vconsole-setup[151]: Configuration of first virtual console was skipped, ignoring remaining ones.565gitlab # [ 2.255832] systemd[1]: Finished Virtual Console Setup.566gitlab # [ 2.260529] systemd-fsck[156]: nixos: clean, 12/65536 files, 13019/262144 blocks567gitlab # [ 2.263396] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.568gitlab # [ 2.510480] ata2: found unknown device (class 0)569gitlab # [ 2.512939] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100570gitlab # [ 2.517185] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5571gitlab # [ 2.535290] usb 1-1: new full-speed USB device number 2 using uhci_hcd572gitlab # [ 2.554452] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0573gitlab # [ 2.580597] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray574gitlab # [ 2.607904] cdrom: Uniform CD-ROM driver Revision: 3.20575gitlab # [ 2.702795] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00576gitlab # [ 2.705605] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10577gitlab # [ 2.708173] usb 1-1: Product: QEMU USB Tablet578gitlab # [ 2.709742] usb 1-1: Manufacturer: QEMU579gitlab # [ 2.711156] usb 1-1: SerialNumber: 28754-0000:00:01.2-1580gitlab # [ 2.744381] hid: raw HID events driver (C) Jiri Kosina581gitlab # [ 2.758392] usbcore: registered new interface driver usbhid582gitlab # [ 2.760406] usbhid: USB HID core driver583gitlab # [ 2.770430] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2584gitlab # [ 2.773871] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0585gitlab # [ 2.890243] systemd[1]: Mounting /sysroot...586gitlab # [ 3.167867] EXT4-fs (vda): mounted filesystem ca0dd655-85f5-4985-9fb9-05ff1bfd2703 r/w with ordered data mode. Quota mode: none.587gitlab # [ 3.037620] systemd[1]: Mounted /sysroot.588gitlab # [ 3.039278] systemd[1]: Reached target Initrd Root File System.589gitlab # [ 3.041173] systemd[1]: Mounting /sysroot/nix/.ro-store...590gitlab # [ 3.042895] systemd[1]: Mounting /sysroot/nix/.rw-store...591gitlab # [ 3.046260] systemd[1]: Mounting /sysroot/run...592gitlab # [ 3.047810] systemd[1]: Mounting /sysroot/tmp/shared...593gitlab # [ 3.049538] systemd[1]: Mounting /sysroot/tmp/xchg...594gitlab # [ 3.053522] systemd[1]: Starting Mountpoints Configured in the Real Root...595gitlab # [ 3.066330] systemd-sysroot-fstab-check[176]: /sysroot should be mounted in the initrd, will request daemon-reload.596gitlab # [ 3.070327] systemd[1]: Reload requested from client PID 176 ('systemd-sysroot') (unit initrd-parse-etc.service)...597gitlab # [ 3.073235] systemd[1]: Reloading...598gitlab # [ 3.209823] 9p: Installing v9fs 9p2000 file system support599gitlab # [ 3.224863] erofs (device vdb): mounted with root inode @ nid 128.600gitlab # [ 3.129250] systemd[1]: Reloading finished in 62 ms.601gitlab # [ 3.155153] systemd-sysroot-fstab-check[176]: Requesting initrd-fs.target/start/replace...602gitlab # [ 3.157738] systemd[1]: Mounted /sysroot/nix/.ro-store.603gitlab # [ 3.159374] systemd[1]: Mounted /sysroot/nix/.rw-store.604gitlab # [ 3.160993] systemd[1]: Mounted /sysroot/run.605gitlab # [ 3.162495] systemd[1]: Mounted /sysroot/tmp/shared.606gitlab # [ 3.164160] systemd[1]: Mounted /sysroot/tmp/xchg.607gitlab # [ 3.165680] systemd-sysroot-fstab-check[176]: Requesting swap.target/start/replace...608gitlab # [ 3.167963] systemd[1]: Starting rw-sysroot-nix-store.service...609gitlab # [ 3.170685] systemd[1]: initrd-parse-etc.service: Deactivated successfully.610gitlab # [ 3.177575] systemd[1]: Finished Mountpoints Configured in the Real Root.611gitlab # [ 3.179607] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.612gitlab # [ 3.187805] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.613gitlab # [ 3.190110] systemd[1]: Finished rw-sysroot-nix-store.service.614gitlab # [ 3.191884] systemd[1]: Mounting /sysroot/nix/store...615gitlab # [ 3.225687] systemd[1]: Mounted /sysroot/nix/store.616gitlab # [ 3.227433] systemd[1]: Reached target Initrd File Systems.617gitlab # [ 3.229463] systemd[1]: Starting Find NixOS closure...618gitlab # [ 3.231275] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...619gitlab # [ 3.252567] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.620gitlab # [ 3.261088] systemd[1]: Finished Find NixOS closure.621gitlab # [ 3.262730] systemd[1]: Reached target Initrd Default Target.622gitlab # [ 3.264488] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...623gitlab # [ 3.285916] systemd[1]: Stopped target Initrd Default Target.624gitlab # [ 3.287369] systemd[1]: Stopped target Basic System.625gitlab # [ 3.288587] systemd[1]: Stopped target Initrd Root Device.626gitlab # [ 3.289896] systemd[1]: Stopped target Path Units.627gitlab # [ 3.291061] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.628gitlab # [ 3.292972] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.629gitlab # [ 3.295444] systemd[1]: Stopped target Slice Units.630gitlab # [ 3.296983] systemd[1]: Stopped target Socket Units.631gitlab # [ 3.298505] systemd[1]: Stopped target System Initialization.632gitlab # [ 3.300264] systemd[1]: Stopped target Swaps.633gitlab # [ 3.301657] systemd[1]: Stopped target Timer Units.634gitlab # [ 3.303702] systemd[1]: dbus.socket: Deactivated successfully.635gitlab # [ 3.306382] systemd[1]: Closed D-Bus System Message Bus Socket.636gitlab # [ 3.309451] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.637gitlab # [ 3.311942] systemd[1]: Stopped Find NixOS closure.638gitlab # [ 3.313194] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio639gitlab # [ 3.316063] systemd[1]: Starting rw-sysroot-nix-store.service...640gitlab # [ 3.317550] systemd[1]: systemd-sysctl.service: Deactivated successfully.641gitlab # [ 3.319206] systemd[1]: Stopped Apply Kernel Variables.642gitlab # [ 3.320429] systemd[1]: systemd-modules-load.service: Deactivated successfully.643gitlab # [ 3.322218] systemd[1]: Stopped Load Kernel Modules.644gitlab # [ 3.323407] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.645gitlab # [ 3.325489] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.646gitlab # [ 3.327340] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.647gitlab # [ 3.328847] systemd[1]: Stopped Create System Files and Directories.648gitlab # [ 3.330102] systemd[1]: Stopped target Local File Systems.649gitlab # [ 3.331217] systemd[1]: Stopped target Preparation for Local File Systems.650gitlab # [ 3.332579] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.651gitlab # [ 3.334057] systemd[1]: Stopped Coldplug All udev Devices.652gitlab # [ 3.335155] systemd[1]: Stopping Rule-based Manager for Device Events and Files...653gitlab # [ 3.336728] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.654gitlab # [ 3.338306] systemd[1]: Stopped Virtual Console Setup.655gitlab # [ 3.339324] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.656gitlab # [ 3.340777] systemd[1]: Finished rw-sysroot-nix-store.service.657gitlab # [ 3.341958] systemd[1]: initrd-cleanup.service: Deactivated successfully.658gitlab # [ 3.343316] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.659gitlab # [ 3.344654] systemd[1]: systemd-udevd.service: Deactivated successfully.660gitlab # [ 3.346029] systemd[1]: Stopped Rule-based Manager for Device Events and Files.661gitlab # [ 3.347226] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.662gitlab # [ 3.348115] systemd[1]: Closed udev Control Socket.663gitlab # [ 3.348703] systemd[1]: Starting Cleanup udev Database...664gitlab # [ 3.349387] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.665gitlab # [ 3.350348] systemd[1]: Stopped Create Static Device Nodes in /dev.666gitlab # [ 3.351122] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.667gitlab # [ 3.352123] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.668gitlab # [ 3.353062] systemd[1]: kmod-static-nodes.service: Deactivated successfully.669gitlab # [ 3.353926] systemd[1]: Stopped Create List of Static Device Nodes.670gitlab # [ 3.354657] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.671gitlab # [ 3.355566] systemd[1]: Finished Cleanup udev Database.672gitlab # [ 3.356242] systemd[1]: Reached target Switch Root.673gitlab # [ 3.356850] systemd[1]: Starting NixOS Activation...674gitlab # [ 3.445250] initrd-nixos-activation-start[228]: booting system configuration /nix/store/cj5z4v0zgfanqqmxficm9ssay1jybbsl-nixos-system-gitlab-test675gitlab # [ 3.491404] initrd-nixos-activation-start[228]: running activation script...676gitlab # [ 3.728736] initrd-nixos-activation-start[251]: setting up /etc...677gitlab # [ 3.847108] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.678gitlab # [ 3.848552] systemd[1]: Finished NixOS Activation.679gitlab # [ 3.850627] systemd[1]: Starting Switch Root...680gitlab # [ 3.881399] systemd[1]: Switching root.681gitlab # [ 4.076842] systemd-journald[91]: Received SIGTERM from PID 1 (systemd).682gitlab # [ 4.206909] NET: Registered PF_VSOCK protocol family683gitlab # [ 4.580694] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)684gitlab # [ 4.590637] systemd[1]: Detected virtualization kvm.685gitlab # [ 4.592437] systemd[1]: Detected architecture x86-64.686gitlab # [ 4.594358] systemd[1]: Detected first boot.687gitlab # [ 4.596797] systemd[1]: Initializing machine ID from random generator.688gitlab # [ 4.736028] systemd[1]: bpf-restrict-fs: LSM BPF program attached689gitlab # [ 4.836336] systemd[1]: Applying preset policy.690gitlab # [ 5.014850] systemd[1]: Populated /etc with preset unit settings.691gitlab # [ 5.128789] systemd[1]: initrd-switch-root.service: Deactivated successfully.692gitlab # [ 5.130082] systemd[1]: Stopped initrd-switch-root.service.693gitlab # [ 5.131988] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.694gitlab # [ 5.133966] systemd[1]: Created slice Slice /system/getty.695gitlab # [ 5.135528] systemd[1]: Created slice GitLab DevOps Platform Slice.696gitlab # [ 5.136934] systemd[1]: Created slice User and Session Slice.697gitlab # [ 5.137908] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.698gitlab # [ 5.139087] systemd[1]: Started Forward Password Requests to Wall Directory Watch.699gitlab # [ 5.140152] systemd[1]: Expecting device /dev/hvc0...700gitlab # [ 5.140852] systemd[1]: Expecting device /dev/ttyS0...701gitlab # [ 5.141561] systemd[1]: Reached target Local Encrypted Volumes.702gitlab # [ 5.142371] systemd[1]: Stopped target initrd-fs.target.703gitlab # [ 5.143122] systemd[1]: Stopped target initrd-root-fs.target.704gitlab # [ 5.143908] systemd[1]: Stopped target initrd-switch-root.target.705gitlab # [ 5.144755] systemd[1]: Reached target Virtual Machines and Containers.706gitlab # [ 5.145617] systemd[1]: Reached target Path Units.707gitlab # [ 5.146314] systemd[1]: Reached target Remote File Systems.708gitlab # [ 5.147092] systemd[1]: Reached target Slice Units.709gitlab # [ 5.147774] systemd[1]: Reached target Swaps.710gitlab # [ 5.149103] systemd[1]: Listening on Query the User Interactively for a Password.711gitlab # [ 5.151029] systemd[1]: Listening on Process Core Dump Socket.712gitlab # [ 5.152361] systemd[1]: Listening on Credential Encryption/Decryption.713gitlab # [ 5.153911] systemd[1]: Listening on Factory Reset Management.714gitlab # [ 5.154846] systemd[1]: Listening on Hostname Service Socket.715gitlab # [ 5.157054] systemd[1]: Starting Journal Log Access Socket...716gitlab # [ 5.158389] systemd[1]: Listening on Journal Audit Socket.717gitlab # [ 5.159940] systemd[1]: Listening on Console Output Muting Service Socket.718gitlab # [ 5.161015] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.719gitlab # [ 5.162097] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os720gitlab # [ 5.163377] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki721gitlab # [ 5.165954] systemd[1]: Listening on Disk Repartitioning Service Socket.722gitlab # [ 5.166931] systemd[1]: Listening on udev Control Socket.723gitlab # [ 5.167779] systemd[1]: Listening on udev Varlink Socket.724gitlab # [ 5.170526] systemd[1]: Mounting Huge Pages File System...725gitlab # [ 5.172566] systemd[1]: Mounting POSIX Message Queue File System...726gitlab # [ 5.174550] systemd[1]: Mounting Kernel Debug File System...727gitlab # [ 5.178269] systemd[1]: Mounting Kernel Trace File System...728gitlab # [ 5.184310] systemd[1]: Starting Create List of Static Device Nodes...729gitlab # [ 5.186690] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio730gitlab # [ 5.193508] systemd[1]: Starting Load Kernel Module configfs...731gitlab # [ 5.194385] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm732gitlab # [ 5.195801] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore733gitlab # [ 5.197275] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse734gitlab # [ 5.214947] systemd[1]: Mounting FUSE Control File System...735gitlab # [ 5.215803] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67736gitlab # [ 5.219665] systemd[1]: Starting Journal Service...737gitlab # [ 5.228403] systemd[1]: Starting Load Kernel Modules...738gitlab # [ 5.230829] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...739gitlab # [ 5.235268] systemd[1]: Starting Remount Root and Kernel File Systems...740gitlab # [ 5.236168] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os741gitlab # [ 5.240266] systemd[1]: Starting Coldplug All udev Devices...742gitlab # [ 5.242908] systemd[1]: Listening on Journal Log Access Socket.743gitlab # [ 5.244449] systemd[1]: Mounted Huge Pages File System.744gitlab # [ 5.245411] systemd[1]: Mounted POSIX Message Queue File System.745gitlab # [ 5.246384] systemd[1]: Mounted Kernel Debug File System.746gitlab # [ 5.247290] systemd[1]: Mounted Kernel Trace File System.747gitlab # [ 5.248556] systemd[1]: Finished Create List of Static Device Nodes.748gitlab # [ 5.249815] systemd[1]: modprobe@configfs.service: Deactivated successfully.749gitlab # [ 5.251272] systemd[1]: Finished Load Kernel Module configfs.750gitlab # [ 5.252575] systemd[1]: Mounted FUSE Control File System.751gitlab # [ 5.254988] systemd[1]: Mounting Kernel Configuration File System...752gitlab # [ 5.257457] systemd-journald[322]: Collecting audit messages is enabled.753gitlab # [ 5.259439] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...754gitlab # [ 5.260225] EXT4-fs (vda): re-mounted ca0dd655-85f5-4985-9fb9-05ff1bfd2703.755gitlab # [ 5.269812] systemd[1]: Finished Remount Root and Kernel File Systems.756gitlab # [ 5.272090] systemd[1]: Listening on Disk Image Download Service Socket.757gitlab # [ 5.273152] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore758gitlab # [ 5.140436] systemd[1]: Queued start job for default target Multi-User System.759gitlab # [ 5.141582] systemd[1]: Unnecessary job was removed for /dev/vdb.760gitlab # [ 5.142678] systemd[1]: systemd-journald.service: Deactivated[ 5.278900] loop: module loaded761gitlab # successfully.762gitlab # [ 5.144464] systemd-modules-load[323]: Using 3 probe threads763gitlab # [ 5.281469] systemd[1]: Starting Load/Save OS Random Seed...764gitlab # [ 5.282350] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os765gitlab # [ 5.147738] systemd-modules-load[323]: Inserted module 'tls'766gitlab # [ 5.148724] systemd-modules-load[323]: Inserted module 'loop'767gitlab # [ 5.287620] systemd[1]: Started Journal Service.768gitlab # [ 5.153385] systemd[1]: Finished Load Kernel Modules.769gitlab # [ 5.154310] systemd[1]: Mounted Kernel Configuration File System.770gitlab # [ 5.157634] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.771gitlab # [ 5.158990] systemd-oomd[325]: No swap; memory pressure usage will be degraded772gitlab # [ 5.160356] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.773gitlab # [ 5.163239] systemd[1]: Finished Load/Save OS Random Seed.774gitlab # [ 5.164277] systemd[1]: Reached target First Boot Complete.775gitlab # [ 5.165422] systemd[1]: Starting Firewall...776gitlab # [ 5.166366] systemd[1]: Starting Flush Journal to Persistent Storage...777gitlab # [ 5.177125] systemd[1]: Starting Apply Kernel Variables...778gitlab # [ 5.179203] systemd[1]: Starting Create Static Device Nodes in /dev...779gitlab # [ 5.321259] systemd-journald[322]: Received client request to flush runtime journal.780gitlab # [ 5.219844] systemd[1]: Finished Apply Kernel Variables.781gitlab # [ 5.221112] systemd[1]: Finished Create Static Device Nodes in /dev.782gitlab # [ 5.221951] systemd[1]: Reached target Preparation for Local File Systems.783gitlab # [ 5.222854] systemd[1]: Starting Rule-based Manager for Device Events and Files...784gitlab # [ 5.223902] systemd[1]: Finished Flush Journal to Persistent Storage.785gitlab # [ 5.229517] systemd-udevd[355]: Using default interface naming scheme 'v261'.786gitlab # [ 5.259808] systemd[1]: Finished Coldplug All udev Devices.787gitlab # [ 5.263172] systemd[1]: Started Rule-based Manager for Device Events and Files.788gitlab # [ 5.328757] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse789gitlab # [ 5.348246] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.790gitlab # [ 5.354343] (udev-worker)[433]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.791gitlab # [ 5.357132] (udev-worker)[433]: Network interface NamePolicy= disabled on kernel command line.792gitlab # [ 5.364272] (udev-worker)[427]: Network interface NamePolicy= disabled on kernel command line.793gitlab # [ 5.371837] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.794gitlab # [ 5.373932] systemd[1]: Condition check resulted in Virtio network device being skipped.795gitlab # [ 5.374970] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore796gitlab # [ 5.376437] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67797gitlab # [ 5.378396] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore798gitlab # [ 5.379786] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os799gitlab # [ 5.381048] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os800gitlab # [ 5.558378] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3801gitlab # [ 5.426037] systemd[1]: Finished Firewall.802gitlab # [ 5.573819] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console803gitlab # [ 5.575206] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input4804gitlab # [ 5.586582] Console: switching to colour dummy device 80x25805gitlab # [ 5.588091] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0806gitlab # [ 5.588891] parport_pc 00:03: reported by Plug and Play ACPI807gitlab # [ 5.588983] [drm] Found bochs VGA, ID 0xb0c5.808gitlab # [ 5.588986] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.809gitlab # [ 5.589035] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]810gitlab # [ 5.591464] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD811gitlab # [ 5.591712] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic812gitlab # [ 5.593322] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0813gitlab # [ 5.598338] Floppy drive(s): fd0 is 2.88M AMI BIOS814gitlab # [ 5.608394] rtc_cmos 00:05: RTC can wake from S4815gitlab # [ 5.608506] Console: switching to colour frame buffer device 160x50816gitlab # [ 5.609738] FDC 0 is a S82078B817gitlab # [ 5.611017] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device818gitlab # [ 5.612225] rtc_cmos 00:05: registered as rtc0819gitlab # [ 5.612774] rtc_cmos 00:05: setting system clock to 2026-08-23T07:10:11 UTC (1787469011)820gitlab # [ 5.613834] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs821gitlab # [ 5.614651] ACPI: button: Power Button [PWRF]822gitlab # [ 5.627628] mousedev: PS/2 mouse device common for all mice823gitlab # [ 5.648294] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6824gitlab # [ 5.649480] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5825gitlab # [ 5.538983] systemd[1]: Starting Virtual Console Setup...826gitlab # [ 5.559053] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.827gitlab # [ 5.561226] systemd[1]: Stopped Virtual Console Setup.828gitlab # [ 5.578325] systemd[1]: Starting Virtual Console Setup...829gitlab # [ 5.738458] ppdev: user-space parallel port driver830gitlab # [ 5.760408] kvm_amd: TSC scaling supported831gitlab # [ 5.761019] kvm_amd: Nested Virtualization enabled832gitlab # [ 5.761695] kvm_amd: Nested Paging enabled833gitlab # [ 5.762332] kvm_amd: LBR virtualization supported834gitlab # [ 5.763000] kvm_amd: Virtual VMLOAD VMSAVE supported835gitlab # [ 5.763735] kvm_amd: Virtual GIF supported836gitlab # [ 5.764397] kvm_amd: Virtual NMI enabled837gitlab # [ 5.657269] systemd-vconsole-setup[495]: Configuration of first virtual console was skipped, ignoring remaining ones.838gitlab # [ 5.659182] systemd[1]: Finished Virtual Console Setup.839gitlab # [ 5.798827] EDAC MC: Ver: 3.0.0840gitlab # [ 5.997430] systemd[1]: Mounting /run/wrappers...841gitlab # [ 6.018890] systemd[1]: Mounted /run/wrappers.842gitlab # [ 6.020916] systemd[1]: Reached target Local File Systems.843gitlab # [ 6.023231] systemd[1]: Listening on Boot Loader Control Service Socket.844gitlab # [ 6.025844] systemd[1]: Starting register-nix-paths.service...845gitlab # [ 6.028357] systemd[1]: Starting Create SUID/SGID Wrappers...846gitlab # [ 6.030718] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.847gitlab # [ 6.034185] systemd[1]: Starting Save Transient machine-id to Disk...848gitlab # [ 6.037718] systemd[1]: Starting Create System Files and Directories...849gitlab # [ 6.068375] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.850gitlab # [ 6.070858] systemd[1]: Finished Save Transient machine-id to Disk.851gitlab # [ 6.087368] systemd[1]: Finished Create System Files and Directories.852gitlab # [ 6.093270] systemd[1]: Starting Rebuild Journal Catalog...853gitlab # [ 6.099750] systemd[1]: Starting Record System Boot/Shutdown in UTMP...854gitlab # [ 6.116241] systemd[1]: Finished Record System Boot/Shutdown in UTMP.855gitlab # [ 6.126132] systemd[1]: Finished Rebuild Journal Catalog.856gitlab # [ 6.127752] systemd[1]: Starting Update is Completed...857gitlab # [ 6.140679] systemd[1]: Finished Update is Completed.858gitlab # [ 6.192407] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.859gitlab # [ 6.194176] systemd[1]: Finished Create SUID/SGID Wrappers.860gitlab # [ 6.461250] systemd[1]: Finished register-nix-paths.service.861gitlab # [ 6.463329] systemd[1]: Reached target System Initialization.862gitlab # [ 6.465272] systemd[1]: Started Discard unused filesystem blocks once a week.863gitlab # [ 6.467791] systemd[1]: Started logrotate.timer.864gitlab # [ 6.469628] systemd[1]: Started Daily Cleanup of Temporary Directories.865gitlab # [ 6.472147] systemd[1]: Reached target Timer Units.866gitlab # [ 6.474055] systemd[1]: Listening on D-Bus System Message Bus Socket.867gitlab # [ 6.476274] systemd[1]: Listening on Nix Daemon Socket.868gitlab # [ 6.478163] systemd[1]: Starting nixbot CI service socket...869gitlab # [ 6.480082] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.870gitlab # [ 6.482787] systemd[1]: Starting D-Bus System Message Bus...871gitlab # [ 6.484766] systemd[1]: Listening on nixbot CI service socket.872gitlab # [ 6.486851] systemd[1]: Reached target Socket Units.873gitlab # [ 6.539702] dbus-broker-launch[577]: Looking up NSS user entry for 'systemd-timesync'...874gitlab # [ 6.543139] dbus-broker-launch[577]: NSS returned no entry for 'systemd-timesync'875gitlab # [ 6.545780] dbus-broker-launch[577]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"876gitlab # [ 6.551179] systemd[1]: Started D-Bus System Message Bus.877gitlab # [ 6.567277] dbus-broker-launch[577]: Ready878gitlab # [ 6.571288] systemd[1]: Reached target Basic System.879gitlab # [ 6.574286] systemd[1]: Started backdoor.service.880gitlab # [ 6.578818] systemd[1]: Starting gitlab-config.service...881gitlab # [ 6.581133] systemd[1]: Starting Import lastlog data into lastlog2 database...882gitlab # [ 6.597267] systemd[1]: Starting Logrotate configuration check...883gitlab # [ 6.602508] systemd[1]: Starting Name Service Cache Daemon (nsncd)...884gitlab # [ 6.605715] systemd[1]: Starting Post-Boot Actions...885gitlab # [ 6.608962] systemd[1]: Started Reset console on configuration changes.886gitlab # [ 6.616746] systemd[1]: Starting resolvconf update...887gitlab # connecting to host...888gitlab # [ 6.631598] systemd[1]: Finished Post-Boot Actions.889gitlab # [ 6.636573] logrotate[582]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.890gitlab # [ 6.639625] logrotate[582]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf891gitlab: Guest shell says: b'Spawning backdoor root shell...\n'892gitlab # [ 6.641244] logrotate[582]: note: 'monthly' overrides previously specified 'weekly'893gitlab # [ 6.642313] logrotate[582]: Reading state from file: /var/lib/logrotate.status894gitlab: connected to guest root shell895gitlab # [ 6.643745] logrotate[582]: state file /var/lib/logrotate.status does not exist896gitlab: (connecting took 7.28 seconds)897gitlab # [ 6.644627] logrotate[582]: Allocating hash table for state file, size 64 entries898gitlab: (finished: waiting for the VM to finish booting, in 7.28 seconds)899gitlab # [ 6.645805] logrotate[582]: Handling 4 logs900gitlab # [ 6.646830] logrotate[582]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed901gitlab # [ 6.647912] logrotate[582]: considering log /var/log/btmp902gitlab # [ 6.648982] logrotate[582]: Creating new state903gitlab # [ 6.649511] logrotate[582]: Now: 2026-08-23 07:10904gitlab # [ 6.650578] logrotate[582]: Last rotated at 2026-08-23 07:00905gitlab # [ 6.651380] logrotate[582]: log does not need rotating (log has already been rotated)906gitlab # [ 6.652217] logrotate[582]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed907gitlab # [ 6.653049] logrotate[582]: considering log /var/log/wtmp908gitlab # [ 6.653522] logrotate[582]: Creating new state909gitlab # [ 6.654126] logrotate[582]: Now: 2026-08-23 07:10910gitlab # [ 6.654511] logrotate[582]: Last rotated at 2026-08-23 07:00911gitlab # [ 6.654953] logrotate[582]: log does not need rotating (log has already been rotated)912gitlab # [ 6.655480] logrotate[582]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed913gitlab # [ 6.655922] logrotate[582]: switching euid from 0 to 165 and egid from 0 to 165 (pid 582)914gitlab # [ 6.656450] logrotate[582]: considering log /var/gitlab/state/log/*.log915gitlab # [ 6.656880] logrotate[582]: log /var/gitlab/state/log/*.log does not exist -- skipping916gitlab # [ 6.657405] logrotate[582]: Creating new state917gitlab # [ 6.657844] logrotate[582]: switching euid from 165 to 0 and egid from 165 to 0 (pid 582)918gitlab # [ 6.658383] logrotate[582]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed919gitlab # [ 6.659081] logrotate[582]: switching euid from 0 to 60 and egid from 0 to 60 (pid 582)920gitlab # [ 6.659464] logrotate[582]: considering log /var/log/nginx/*.log921gitlab # [ 6.659921] logrotate[582]: log /var/log/nginx/*.log does not exist -- skipping922gitlab # [ 6.660462] logrotate[582]: Creating new state923gitlab # [ 6.660937] logrotate[582]: not running postrotate script, since no logs were rotated924gitlab # [ 6.661489] logrotate[582]: switching euid from 60 to 0 and egid from 60 to 0 (pid 582)925gitlab # [ 6.661835] systemd[1]: Finished Import lastlog data into lastlog2 database.926gitlab # [ 6.672181] nsncd[583]: Aug 23 07:10:12.695 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"927gitlab # [ 6.674100] systemd[1]: Started Name Service Cache Daemon (nsncd).928gitlab # [ 6.674878] systemd[1]: Finished Logrotate configuration check.929gitlab # [ 6.676240] systemd[1]: Reached target Host and Network Name Lookups.930gitlab # [ 6.677106] systemd[1]: Reached target User and Group Name Lookups.931gitlab # [ 6.679975] systemd[1]: Starting User Login Management...932gitlab # [ 6.706474] systemd[1]: Stopped target Host and Network Name Lookups.933gitlab # [ 6.707431] systemd[1]: Stopping Host and Network Name Lookups...934gitlab # [ 6.708372] systemd[1]: Stopped target User and Group Name Lookups.935gitlab # [ 6.709439] systemd[1]: Stopping User and Group Name Lookups...936gitlab # [ 6.710382] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...937gitlab # [ 6.711343] systemd[1]: nscd.service: Deactivated successfully.938gitlab # [ 6.712224] systemd[1]: Stopped Name Service Cache Daemon (nsncd).939gitlab # [ 6.713099] systemd[1]: nscd.service: Consumed 17ms CPU time over 107ms wall clock time, 7.5M memory peak, 5.5M read from disk.940gitlab # [ 6.714625] systemd[1]: Starting Name Service Cache Daemon (nsncd)...941gitlab # [ 6.718418] systemd-logind[630]: New seat seat0.942gitlab # [ 6.725778] systemd-logind[630]: Watching system buttons on /dev/input/event2 (Power Button)943gitlab # [ 6.726459] systemd-logind[630]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)944gitlab # [ 6.727395] systemd-logind[630]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)945gitlab # [ 6.727792] systemd[1]: Started User Login Management.946gitlab # [ 6.728528] systemd[1]: Starting linger-users.service...947gitlab # [ 6.735477] nsncd[672]: Aug 23 07:10:12.758 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"948gitlab # [ 6.735979] systemd[1]: Started Name Service Cache Daemon (nsncd).949gitlab # [ 6.736483] systemd[1]: Reached target Host and Network Name Lookups.950gitlab # [ 6.736939] systemd[1]: Reached target User and Group Name Lookups.951gitlab # [ 6.744084] systemd[1]: Finished resolvconf update.952gitlab # [ 6.745268] systemd[1]: Reached target Preparation for Network.953gitlab # [ 6.747480] systemd[1]: Starting DHCP Client...954gitlab # [ 6.748582] systemd[1]: Starting Address configuration of eth1...955gitlab # [ 6.751687] systemd[1]: Starting Extra networking commands....956gitlab # [ 6.752456] systemd[1]: linger-users.service: Deactivated successfully.957gitlab # [ 6.753385] systemd[1]: Finished linger-users.service.958gitlab # [ 6.772048] network-addresses-eth1-start[699]: adding address 192.168.1.1/24... done959gitlab # [ 6.775426] network-addresses-eth1-start[699]: adding address 2001:db8:1::1/64... done960gitlab # [ 6.780295] systemd[1]: Finished Address configuration of eth1.961gitlab # [ 6.806823] systemd[1]: Finished Extra networking commands..962gitlab # [ 6.807746] systemd[1]: Reached target Network.963gitlab # [ 6.808622] systemd[1]: Starting gitlab-workhorse.service...964gitlab # [ 6.810479] systemd[1]: Starting Nginx Web Server...965gitlab # [ 6.813046] systemd[1]: Starting PostgreSQL Server...966gitlab # [ 6.814764] systemd[1]: Starting Redis Server - redis-gitlab...967gitlab # [ 6.817705] systemd[1]: Starting Permit User Sessions...968gitlab # [ 6.822071] dhcpcd[715]: dhcpcd-10.3.2 starting969gitlab # [ 6.824031] dhcpcd[770]: dev: loaded udev970gitlab # [ 6.965837] 8021q: 802.1Q VLAN Support v1.8971gitlab # [ 6.966592] 8021q: adding VLAN 0 to HW filter on device eth1972gitlab # [ 6.833197] systemd[1]: Finished Permit User Sessions.973gitlab # [ 6.837479] systemd[1]: Started Getty on tty1.974gitlab # [ 6.845051] systemd[1]: Reached target Login Prompts.975gitlab # [ 6.845717] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.976gitlab # [ 7.048785] cfg80211: Loading compiled-in X.509 certificates for regulatory database977gitlab # [ 7.052557] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'978gitlab # [ 7.053373] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'979gitlab # [ 7.054617] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2980gitlab # [ 7.055879] cfg80211: failed to load regulatory.db981gitlab # [ 6.931868] nginx-pre-start[790]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok982gitlab # [ 6.933460] nginx-pre-start[790]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful983gitlab # [ 6.939382] systemd[1]: Started Nginx Web Server.984gitlab # [ 6.949153] redis-server[789]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.985gitlab # [ 6.949907] redis-server[789]: oO0OoO0OoO0Oo Redis i[ 7.087530] 8021q: adding VLAN 0 to HW filter on device eth0986gitlab # s starting oO0OoO0OoO0Oo987gitlab # [ 6.952098] redis-server[789]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=789, just started988gitlab # [ 6.953382] redis-server[789]: Configuration loaded989gitlab # [ 6.953874] redis[789]: monotonic clock: POSIX clock_gettime990gitlab # [ 6.955095] redis[789]: Running mode=standalone, port=0.991gitlab # [ 6.956191] systemd[1]: Started Redis Server - redis-gitlab.992gitlab # [ 6.957577] redis[789]: Server initialized993gitlab # [ 6.958132] redis[789]: Ready to accept connections unix994gitlab # [ 6.958708] dhcpcd[770]: eth0: waiting for carrier995gitlab # [ 6.959584] dhcpcd[770]: eth0: carrier acquired996gitlab # [ 6.960084] redis[789]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.997gitlab # [ 6.960352] dhcpcd[770]: DUID 00:01:00:01:32:1d:59:54:52:54:00:12:34:56998gitlab # [ 6.960857] dhcpcd[770]: eth0: IAID 00:12:34:56999gitlab # [ 6.961467] dhcpcd[770]: eth0: adding address fe80::5054:ff:fe12:34561000gitlab # [ 6.967787] postgresql-pre-start[793]: The files belonging to this database system will be owned by user "postgres".1001gitlab # [ 6.968727] postgresql-pre-start[793]: This user must also own the server process.1002gitlab # [ 6.971058] postgresql-pre-start[793]: The database cluster will be initialized with locale "en_US.UTF-8".1003gitlab # [ 6.971494] postgresql-pre-start[793]: The default database encoding has accordingly been set to "UTF8".1004gitlab # [ 6.972049] postgresql-pre-start[793]: The default text search configuration will be set to "english".1005gitlab # [ 6.972579] postgresql-pre-start[793]: Data page checksums are enabled.1006gitlab # [ 6.973178] postgresql-pre-start[793]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok1007gitlab # [ 6.973471] postgresql-pre-start[793]: creating subdirectories ... ok1008gitlab # [ 6.974029] postgresql-pre-start[793]: selecting dynamic shared memory implementation ... posix1009gitlab # [ 7.001779] postgresql-pre-start[793]: selecting default "max_connections" ... 1001010gitlab # [ 7.036145] postgresql-pre-start[793]: selecting default "shared_buffers" ... 128MB1011gitlab # [ 7.326945] systemd[1]: Started gitlab-workhorse.service.1012gitlab # [ 7.402310] postgresql-pre-start[793]: selecting default time zone ... UTC1013gitlab # [ 7.403896] postgresql-pre-start[793]: creating configuration files ... ok1014gitlab # [ 7.444296] dhcpcd[770]: eth0: soliciting a DHCP lease1015gitlab # [ 7.588598] NET: Registered PF_PACKET protocol family1016gitlab # [ 7.464623] dhcpcd[770]: eth0: offered 10.0.2.15 from 10.0.2.21017gitlab # [ 7.471652] dhcpcd[770]: eth0: probing address 10.0.2.15/241018gitlab # [ 7.502239] gitlab-workhorse[825]: time="2026-08-23T07:10:13Z" level=info msg=Starting build_time=19700101.000000 version=19.0.41019gitlab # [ 7.506259] gitlab-workhorse[825]: time="2026-08-23T07:10:13Z" level=info msg="Using redis/go-redis"1020gitlab # [ 7.508554] gitlab-workhorse[825]: time="2026-08-23T07:10:13Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1021gitlab # [ 7.562845] postgresql-pre-start[793]: running bootstrap script ... ok1022gitlab # [ 7.993795] postgresql-pre-start[793]: performing post-bootstrap initialization ... ok1023gitlab # [ 8.271290] postgresql-pre-start[793]: syncing data to disk ... ok1024gitlab # [ 8.273165] postgresql-pre-start[793]: initdb: warning: enabling "trust" authentication for local connections1025gitlab # [ 8.274510] postgresql-pre-start[793]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1026gitlab # [ 8.276065] postgresql-pre-start[793]: Success. You can now start the database server using:1027gitlab # [ 8.277163] postgresql-pre-start[793]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1028gitlab # [ 8.382391] postgres[850]: [850] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1029gitlab # [ 8.386513] postgres[850]: [850] LOG: listening on IPv6 address "::1", port 54321030gitlab # [ 8.388417] postgres[850]: [850] LOG: listening on IPv4 address "127.0.0.1", port 54321031gitlab # [ 8.395829] postgres[850]: [850] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1032gitlab # [ 8.413398] postgres[860]: [860] LOG: database system was shut down at 2026-08-23 07:10:14 GMT1033gitlab # [ 8.425721] postgres[850]: [850] LOG: database system is ready to accept connections1034gitlab # [ 8.430623] systemd[1]: Started PostgreSQL Server.1035gitlab # [ 8.435063] systemd[1]: Starting PostgreSQL Setup Scripts...1036gitlab # [ 8.656351] postgresql-setup-start[871]: CREATE DATABASE1037gitlab # [ 8.674843] postgresql-setup-start[880]: CREATE ROLE1038gitlab # [ 8.682892] postgresql-setup-start[882]: ALTER DATABASE1039gitlab # [ 8.704264] postgresql-setup-start[888]: CREATE ROLE1040gitlab # [ 8.706614] systemd[1]: Finished PostgreSQL Setup Scripts.1041gitlab # [ 8.707612] systemd[1]: Reached target PostgreSQL.1042gitlab # [ 8.708719] systemd[1]: Starting gitlab-postgresql.service...1043gitlab # [ 8.790668] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[876]: mkdir -p /var/gitlab/state/home/.ssh: OK1044gitlab # [ 8.793235] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[876]: chmod 700 /var/gitlab/state/home/.ssh: OK1045gitlab # [ 8.808148] gitlab-postgresql-start[896]: CREATE DATABASE1046gitlab # [ 8.828194] systemd[1]: Finished gitlab-config.service.1047gitlab # [ 8.832735] systemd[1]: Started gitaly.service.1048gitlab # [ 8.836087] systemd[1]: Starting gitlab-db-config.service...1049gitlab # [ 8.839165] gitlab-postgresql-start[920]: CREATE EXTENSION1050gitlab # [ 8.925275] gitlab-postgresql-start[925]: CREATE EXTENSION1051gitlab # [ 8.927113] systemd[1]: Finished gitlab-postgresql.service.1052gitlab # [ 9.327105] gitaly[923]: time="2026-08-23T07:10:15.349Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=9231053gitlab # [ 9.327880] gitaly[923]: time="2026-08-23T07:10:15.350Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=9231054gitlab # [ 9.328884] gitaly[923]: time="2026-08-23T07:10:15.350Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=9231055gitlab # [ 9.331581] gitaly[923]: time="2026-08-23T07:10:15.350Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=9231056gitlab # [ 9.332286] gitaly[923]: time="2026-08-23T07:10:15.350Z" level=info msg="Starting Gitaly" pid=923 version=1057gitlab # [ 9.368388] dhcpcd[770]: eth0: soliciting an IPv6 router1058gitlab # [ 9.371106] dhcpcd[770]: eth0: Router Advertisement from fe80::21059gitlab # [ 9.371906] dhcpcd[770]: eth0: adding address fec0::5054:ff:fe12:3456/641060gitlab # [ 9.373091] dhcpcd[770]: eth0: adding route to fec0::/641061gitlab # [ 9.373699] dhcpcd[770]: eth0: adding default route via fe80::21062gitlab # [ 9.506082] gitaly[923]: time="2026-08-23T07:10:15.529Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=178 pid=9231063gitlab # [ 9.507317] gitaly[923]: time="2026-08-23T07:10:15.530Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=9231064gitlab # [ 9.508090] gitaly[923]: time="2026-08-23T07:10:15.530Z" level=info msg="finished initializing command factory" duration_ms=0 pid=9231065gitlab # [ 9.508583] gitaly[923]: time="2026-08-23T07:10:15.530Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-923/git-exec-53777812.d/git pid=9231066gitlab # [ 9.512429] gitaly[923]: time="2026-08-23T07:10:15.535Z" level=info msg="finished detecting git version" duration_ms=5 pid=9231067gitlab # [ 9.513082] gitaly[923]: time="2026-08-23T07:10:15.535Z" level=info msg="using Git version" pid=923 version=2.53.g1068gitlab # [ 9.513536] gitaly[923]: time="2026-08-23T07:10:15.536Z" level=info msg="clearing disk cache object folder" pid=923 storage=default1069gitlab # [ 9.514064] gitaly[923]: time="2026-08-23T07:10:15.536Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2752019007 pid=923 storage=default1070gitlab # [ 9.514540] gitaly[923]: time="2026-08-23T07:10:15.536Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2752019007 pid=923 storage=default1071gitlab # [ 9.515150] gitaly[923]: time="2026-08-23T07:10:15.536Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=9231072gitlab # [ 9.515598] gitaly[923]: time="2026-08-23T07:10:15.536Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=9231073gitlab # [ 9.516145] gitaly[923]: time="2026-08-23T07:10:15.536Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2752019007 clear_duration_ms=0 pid=923 storage=default1074gitlab # [ 9.563955] gitaly[923]: time="2026-08-23T07:10:15.587Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=9231075gitlab # [ 9.564625] gitaly[923]: time="2026-08-23T07:10:15.587Z" level=info msg="counting repositories" pid=9231076gitlab # [ 9.565077] gitaly[923]: time="2026-08-23T07:10:15.587Z" level=info msg="starting to count repositories" pid=923 storage_path=/var/gitlab/state/repositories1077gitlab # [ 9.565495] gitaly[923]: time="2026-08-23T07:10:15.587Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=923 schema=unix1078gitlab # [ 9.565922] gitaly[923]: time="2026-08-23T07:10:15.587Z" level=info msg="listening at address" address=/run/gitaly/gitaly-923/sock.d/intern pid=923 schema=unix1079gitlab # [ 9.566763] gitaly[923]: time="2026-08-23T07:10:15.589Z" level=info msg="finished tempdir cleaner walk" pid=923 storage=default time_ms=01080gitlab # [ 9.573682] gitaly[923]: time="2026-08-23T07:10:15.597Z" level=info msg="completed counting repositories" counting_duration_ms=9 pid=923 storage_path=/var/gitlab/state/repositories1081gitlab # [ 9.574391] gitaly[923]: time="2026-08-23T07:10:15.597Z" level=info msg="completed counting all repositories" counting_duration=9 pid=9231082gitlab # [ 9.574834] gitaly[923]: time="2026-08-23T07:10:15.597Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9231083gitlab # [ 9.575392] gitaly[923]: time="2026-08-23T07:10:15.597Z" level=info msg="Started Gitaly" duration_ms=247 pid=9231084gitlab # [ 9.575797] gitaly[923]: time="2026-08-23T07:10:15.597Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9231085gitlab # [ 9.576463] gitaly[923]: time="2026-08-23T07:10:15.598Z" level=info msg="maintenance: daily scheduled" pid=923 scheduled="2026-08-23 12:00:00 +0000 UTC"1086gitlab # [ 10.291365] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[928]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1087gitlab # [ 10.294062] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[928]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1088gitlab # [ 10.319835] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[928]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1089gitlab # [ 11.487995] gitaly[923]: time="2026-08-23T07:10:17.510Z" level=info msg="License database preloaded" duration_ms=2160 pid=9231090gitlab # [ 12.601893] dhcpcd[770]: eth0: leased 10.0.2.15 for 86400 seconds1091gitlab # [ 12.603367] dhcpcd[770]: eth0: adding route to 10.0.2.0/241092gitlab # [ 12.604649] dhcpcd[770]: eth0: adding default route via 10.0.2.21093gitlab # [ 12.719884] systemd[1]: Started DHCP Client.1094gitlab # [ 12.722612] systemd[1]: Reached target Network is Online.1095gitlab # [ 39.980615] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[928]: W, [2026-08-23T07:10:46.003151 #928] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1096gitlab # [ 42.119798] postgres[1309]: [1309] ERROR: relation "feature_gates" does not exist at character 5231097gitlab # [ 42.121334] postgres[1309]: [1309] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1098gitlab # [ 42.122583] postgres[1309]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1099gitlab # [ 42.124357] postgres[1309]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1100gitlab # [ 42.125858] postgres[1309]: attidentity AS identity,1101gitlab # [ 42.128073] postgres[1309]: attgenerated as attgenerated1102gitlab # [ 42.129818] postgres[1309]: FROM pg_attribute a1103gitlab # [ 42.131282] postgres[1309]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1104gitlab # [ 42.133097] postgres[1309]: LEFT JOIN pg_type t ON a.atttypid = t.oid1105gitlab # [ 42.134460] postgres[1309]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1106gitlab # [ 42.136246] postgres[1309]: WHERE a.attrelid = '"feature_gates"'::regclass1107gitlab # [ 42.138059] postgres[1309]: AND a.attnum > 0 AND NOT a.attisdropped1108gitlab # [ 42.139447] postgres[1309]: ORDER BY a.attnum1109gitlab # [ 42.140879] postgres[1309]:1110gitlab # [ 45.527272] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1351]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1111gitlab # [ 45.529535] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1351]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1112gitlab # [ 47.561391] gitlab-workhorse[825]: time="2026-08-23T07:10:53Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1113gitlab # [ 57.571426] gitlab-workhorse[825]: time="2026-08-23T07:11:03Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1114gitlab # [ 60.485441] postgres[1417]: [1417] ERROR: relation "table_without_models" does not exist1115gitlab # [ 60.487316] postgres[1417]: [1417] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1116gitlab # [ 67.581699] gitlab-workhorse[825]: time="2026-08-23T07:11:13Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1117gitlab # [ 72.572379] systemd[1]: Finished gitlab-db-config.service.1118gitlab # [ 72.576275] systemd[1]: Started gitlab-sidekiq.service.1119gitlab # [ 72.578768] systemd[1]: Starting gitlab.service...1120gitlab # [ 72.935105] bundle[1584]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1121gitlab # [ 72.939574] bundle[1584]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1122gitlab # [ 72.943891] bundle[1584]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1123gitlab # [ 75.612139] sidekiq-cluster[1583]: {"severity":"INFO","time":"2026-08-23T07:11:21.618Z","message":"Starting cluster with 1 processes"}1124gitlab # [ 75.715093] bundle[1584]: {"timestamp":"2026-08-23T07:11:21.715Z","pid":1584,"message":"* Enabling systemd notification integration"}1125gitlab # [ 75.718899] bundle[1584]: {"timestamp":"2026-08-23T07:11:21.737Z","pid":1584,"message":"Puma starting in cluster mode..."}1126gitlab # [ 75.722478] bundle[1584]: {"timestamp":"2026-08-23T07:11:21.737Z","pid":1584,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1127gitlab # [ 75.725951] bundle[1584]: {"timestamp":"2026-08-23T07:11:21.737Z","pid":1584,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1128gitlab # [ 75.730124] bundle[1584]: {"timestamp":"2026-08-23T07:11:21.737Z","pid":1584,"message":"* Min threads: 0"}1129gitlab # [ 75.733122] bundle[1584]: {"timestamp":"2026-08-23T07:11:21.737Z","pid":1584,"message":"* Max threads: 4"}1130gitlab # [ 75.736117] bundle[1584]: {"timestamp":"2026-08-23T07:11:21.737Z","pid":1584,"message":"* Environment: production"}1131gitlab # [ 75.739330] bundle[1584]: {"timestamp":"2026-08-23T07:11:21.737Z","pid":1584,"message":"* Master PID: 1584"}1132gitlab # [ 75.742293] bundle[1584]: {"timestamp":"2026-08-23T07:11:21.737Z","pid":1584,"message":"* Workers: 2"}1133gitlab # [ 75.745171] bundle[1584]: {"timestamp":"2026-08-23T07:11:21.737Z","pid":1584,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1134gitlab # [ 75.748711] bundle[1584]: {"timestamp":"2026-08-23T07:11:21.737Z","pid":1584,"message":"* Preloading application"}1135gitlab # [ 77.592087] gitlab-workhorse[825]: time="2026-08-23T07:11:23Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1136gitlab # [ 87.602121] gitlab-workhorse[825]: time="2026-08-23T07:11:33Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1137gitlab # [ 97.611498] gitlab-workhorse[825]: time="2026-08-23T07:11:43Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1138gitlab # [ 97.935526] bundle[1584]: W, [2026-08-23T07:11:43.958018 #1584] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1139gitlab # [ 100.281286] sidekiq-cluster[1614]: 2026-08-23T07:11:46.303Z pid=1614 tid=wkm INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1614, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>439840768}1140gitlab # [ 100.443790] sidekiq-cluster[1614]: W, [2026-08-23T07:11:46.466893 #1614] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1141gitlab # [ 100.483260] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:46.506Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1142gitlab # [ 102.394562] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.417Z","message":"GitLab reliable fetch activated!"}1143gitlab # [ 102.398204] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.417Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1144gitlab # [ 102.415762] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.439Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1145gitlab # [ 102.421261] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.441Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1146gitlab # [ 102.422869] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.443Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1147gitlab # [ 102.431732] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.454Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1148gitlab # [ 102.439348] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.462Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1149gitlab # [ 102.446162] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.469Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1150gitlab # [ 102.452891] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.476Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1151gitlab # [ 102.459319] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.482Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1152gitlab # [ 102.465926] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.489Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1153gitlab # [ 102.474447] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.497Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1154gitlab # [ 102.478680] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.500Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1155gitlab # [ 102.482570] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.505Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1156gitlab # [ 102.485163] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.508Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1157gitlab # [ 102.489428] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.512Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1158gitlab # [ 102.494028] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.517Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1159gitlab # [ 102.498763] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.522Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1160gitlab # [ 102.503958] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.527Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1161gitlab # [ 102.509298] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.532Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1162gitlab # [ 102.514644] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.537Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1163gitlab # [ 102.519618] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.542Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1164gitlab # [ 102.524229] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.547Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1165gitlab # [ 102.528024] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.551Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1166gitlab # [ 102.531218] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.554Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1167gitlab # [ 102.534927] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.558Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1168gitlab # [ 102.539165] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.562Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1169gitlab # [ 102.541866] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.565Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1170gitlab # [ 102.544452] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.567Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1171gitlab # [ 102.547529] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.570Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1172gitlab # [ 102.550196] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.573Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1173gitlab # [ 102.552902] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.576Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1174gitlab # [ 102.555444] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.578Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1175gitlab # [ 102.558158] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.581Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1176gitlab # [ 102.560815] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.584Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1177gitlab # [ 102.563290] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.586Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1178gitlab # [ 102.565907] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.589Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1179gitlab # [ 102.568070] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.591Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1180gitlab # [ 102.570520] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.593Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1181gitlab # [ 102.573223] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.596Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1182gitlab # [ 102.575569] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.598Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1183gitlab # [ 102.580245] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.603Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1184gitlab # [ 102.584161] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.607Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1185gitlab # [ 102.587434] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.610Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1186gitlab # [ 102.591216] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.614Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1187gitlab # [ 102.595050] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.618Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1188gitlab # [ 102.598913] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.622Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1189gitlab # [ 102.603071] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.626Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1190gitlab # [ 102.605364] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.628Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1191gitlab # [ 102.607590] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.630Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1192gitlab # [ 102.610174] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.633Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1193gitlab # [ 102.612626] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.635Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1194gitlab # [ 102.615094] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.638Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1195gitlab # [ 102.617794] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.641Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1196gitlab # [ 102.627402] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.650Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1197gitlab # [ 102.630022] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.653Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1198gitlab # [ 102.632433] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.655Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1199gitlab # [ 102.634814] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.658Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1200gitlab # [ 102.637219] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.660Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1201gitlab # [ 102.639854] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.663Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1202gitlab # [ 102.641733] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.665Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1203gitlab # [ 102.644214] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.667Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1204gitlab # [ 102.646563] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.669Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1205gitlab # [ 102.648210] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.671Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1206gitlab # [ 102.650803] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.674Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1207gitlab # [ 102.653496] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.676Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1208gitlab # [ 102.655843] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.679Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1209gitlab # [ 102.658388] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.681Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1210gitlab # [ 102.660475] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.683Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1211gitlab # [ 102.664778] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.688Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1212gitlab # [ 102.668322] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.691Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1213gitlab # [ 102.672876] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.696Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1214gitlab # [ 102.676448] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.699Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1215gitlab # [ 102.678632] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.701Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1216gitlab # [ 102.680726] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.704Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1217gitlab # [ 102.682903] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.706Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1218gitlab # [ 102.684973] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.708Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1219gitlab # [ 102.687166] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.710Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1220gitlab # [ 102.689361] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.712Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1221gitlab # [ 102.691629] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.714Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1222gitlab # [ 102.693475] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.716Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1223gitlab # [ 102.695460] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.718Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1224gitlab # [ 102.697425] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.720Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1225gitlab # [ 102.699418] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.722Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1226gitlab # [ 102.702128] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.725Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1227gitlab # [ 102.704148] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.727Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1228gitlab # [ 102.706381] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.729Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1229gitlab # [ 102.708421] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.731Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1230gitlab # [ 102.711193] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.734Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1231gitlab # [ 102.713177] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.736Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1232gitlab # [ 102.715358] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.738Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1233gitlab # [ 102.717237] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.740Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1234gitlab # [ 102.719455] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.742Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1235gitlab # [ 102.721461] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.744Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1236gitlab # [ 102.723450] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.746Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1237gitlab # [ 102.725514] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.748Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1238gitlab # [ 102.728258] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.751Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1239gitlab # [ 102.730735] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.754Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1240gitlab # [ 102.733022] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.756Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1241gitlab # [ 102.735157] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.758Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1242gitlab # [ 102.744629] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.767Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1243gitlab # [ 102.746772] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.770Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1244gitlab # [ 102.748807] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.772Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1245gitlab # [ 102.752087] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.775Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1246gitlab # [ 102.754759] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.778Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1247gitlab # [ 102.757302] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.780Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1248gitlab # [ 102.760299] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.783Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1249gitlab # [ 102.762329] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.785Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1250gitlab # [ 102.764369] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.787Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1251gitlab # [ 102.767366] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.790Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1252gitlab # [ 102.769344] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:11:48.792Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1253gitlab # [ 107.621911] gitlab-workhorse[825]: time="2026-08-23T07:11:53Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1254gitlab # [ 117.622393] gitlab-workhorse[825]: time="2026-08-23T07:12:03Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1255gitlab # [ 127.401423] postgres[2061]: [2061] ERROR: relation "table_without_models" does not exist1256gitlab # [ 127.402641] postgres[2061]: [2061] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1257gitlab # [ 127.623768] gitlab-workhorse[825]: time="2026-08-23T07:12:13Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1258gitlab # [ 128.397728] postgres[2067]: [2067] ERROR: relation "table_without_models" does not exist1259gitlab # [ 128.400304] postgres[2067]: [2067] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1260gitlab # [ 129.947449] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:15.969Z","message":"Booted Rails 7.2.3.1 application in production environment"}1261gitlab # [ 129.949326] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:15.972Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1262gitlab # [ 129.950225] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:15.972Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1263gitlab # [ 129.951093] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:15.972Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1264gitlab # [ 129.953519] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:15.976Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1265gitlab # [ 131.195603] bundle[1584]: {"timestamp":"2026-08-23T07:12:17.218Z","pid":1584,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1266gitlab # [ 131.196624] bundle[1584]: {"timestamp":"2026-08-23T07:12:17.218Z","pid":1584,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1267gitlab # [ 131.197684] bundle[1584]: {"timestamp":"2026-08-23T07:12:17.218Z","pid":1584,"message":"! #\u003cThread:0x00007e5dde6a4e28 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1268gitlab # [ 131.198480] bundle[1584]: {"timestamp":"2026-08-23T07:12:17.218Z","pid":1584,"message":"! #\u003cThread:0x00007e5dde8bf7a8 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1269gitlab # [ 131.199150] bundle[1584]: {"timestamp":"2026-08-23T07:12:17.218Z","pid":1584,"message":"Use Ctrl-C to stop"}1270gitlab # [ 131.199814] bundle[1584]: {"timestamp":"2026-08-23T07:12:17.218Z","pid":1584,"message":"Sending status to systemd every 1.0 sec"}1271gitlab # [ 131.290061] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:17.312Z","message":"Cleaning working queues"}1272gitlab # [ 131.292137] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:17.315Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"73eaaf35dd28f68f9ef3a115","created_at":"2026-08-23T07:11:18.236Z","trace_propagation_headers":{"sentry-trace":"1ad2f5940709402c9827ce27897eb88e-458966675c8c44c5","baggage":"sentry-trace_id=1ad2f5940709402c9827ce27897eb88e,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"6b44ae4ea6a3cca3456cdebf8a3b679c","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-23T07:11:18.243Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-73eaaf35dd28f68f9ef3a115: start","job_status":"start","queue_duration_s":59.071955,"scheduling_latency_s":59.072002}1273gitlab # [ 131.416649] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:17.439Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"73eaaf35dd28f68f9ef3a115","created_at":"2026-08-23T07:11:18.236Z","trace_propagation_headers":{"sentry-trace":"1ad2f5940709402c9827ce27897eb88e-458966675c8c44c5","baggage":"sentry-trace_id=1ad2f5940709402c9827ce27897eb88e,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"6b44ae4ea6a3cca3456cdebf8a3b679c","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-23T07:11:18.243Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-73eaaf35dd28f68f9ef3a115: done: 0.124624 sec","job_status":"done","queue_duration_s":59.071955,"scheduling_latency_s":59.072002,"redis_calls":26,"redis_duration_s":0.004253,"redis_read_bytes":914,"redis_write_bytes":2887,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.002549,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001031,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000673,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.052145,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.07533247900000001,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.124624,"completed_at":"2026-08-23T07:12:17.439Z","load_balancing_strategy":"primary","db_duration_s":0.045027,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1274gitlab # [ 131.521560] bundle[1584]: {"timestamp":"2026-08-23T07:12:17.544Z","pid":1584,"message":"- Worker 0 (PID: 2156) booted in 0.27s, phase: 0"}1275gitlab # [ 131.575141] bundle[1584]: {"timestamp":"2026-08-23T07:12:17.597Z","pid":1584,"message":"- Worker 1 (PID: 2160) booted in 0.3s, phase: 0"}1276gitlab # [ 131.584523] systemd[1]: Started gitlab.service.1277gitlab # [ 131.586105] systemd[1]: Reached target Common target for all GitLab services..1278gitlab # [ 131.588557] systemd[1]: Starting setup-gitlab.service...1279gitlab # [ 131.611330] setup-gitlab-start[2200]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1280gitlab # [ 133.981446] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:12:20 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 23451281gitlab # [ 133.986286] setup-gitlab-start[2200]: + TOKEN=nixbot-test-token-of-20-chars1282gitlab # [ 133.988836] setup-gitlab-start[2200]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1283gitlab # [ 134.000190] runuser[2218]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1284gitlab # [ 134.387769] setup-gitlab-start[2219]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1285gitlab # [ 134.392702] setup-gitlab-start[2219]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1286gitlab # [ 134.397407] setup-gitlab-start[2219]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1287gitlab # [ 134.960683] setup-gitlab-start[2219]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1288gitlab # [ 134.965403] setup-gitlab-start[2219]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1289gitlab # [ 134.969832] setup-gitlab-start[2219]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1290gitlab # [ 142.191096] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:28.213Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"d8e176197ee9b7d78e1d85e6","created_at":"2026-08-23T07:12:28.180Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e6a3cf58c9b4daf1e7816ced4685da18","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:28.210Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-d8e176197ee9b7d78e1d85e6: start","job_status":"start","queue_duration_s":0.002584,"scheduling_latency_s":0.002632}1291gitlab # [ 142.324830] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:28.347Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"d8e176197ee9b7d78e1d85e6","created_at":"2026-08-23T07:12:28.180Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e6a3cf58c9b4daf1e7816ced4685da18","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:28.210Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-d8e176197ee9b7d78e1d85e6: done: 0.134621 sec","job_status":"done","queue_duration_s":0.002584,"scheduling_latency_s":0.002632,"redis_calls":19,"redis_duration_s":0.041906,"redis_read_bytes":21,"redis_write_bytes":4785,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.033295,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000705,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.005803,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.002103,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028751,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001002642,"duration_s":0.134621,"completed_at":"2026-08-23T07:12:28.347Z","load_balancing_strategy":"primary","db_duration_s":0.007307,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1292gitlab # [ 142.394973] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:28.418Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"65241a5784df45fc9806f6c7","created_at":"2026-08-23T07:12:28.254Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1abbb7af64b053c043fe8ca9bd9a4cd7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:28.264Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-65241a5784df45fc9806f6c7: start","job_status":"start","queue_duration_s":0.153673,"scheduling_latency_s":0.153711}1293gitlab # [ 142.422220] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:28.445Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"65241a5784df45fc9806f6c7","created_at":"2026-08-23T07:12:28.254Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1abbb7af64b053c043fe8ca9bd9a4cd7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:28.264Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-65241a5784df45fc9806f6c7: done: 0.027386 sec","job_status":"done","queue_duration_s":0.153673,"scheduling_latency_s":0.153711,"redis_calls":12,"redis_duration_s":0.006195,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000896,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00432,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000979,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010906,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001159365,"duration_s":0.027386,"completed_at":"2026-08-23T07:12:28.445Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00103,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1294gitlab # [ 142.441090] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:28.449Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0204c9b5bdb68960d2419b37","created_at":"2026-08-23T07:12:28.321Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-2e24bff3458542f4","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e6a3cf58c9b4daf1e7816ced4685da18","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:28.337Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0204c9b5bdb68960d2419b37: start","job_status":"start","queue_duration_s":0.112816,"scheduling_latency_s":0.112831}1295gitlab # [ 142.481667] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:28.504Z","message":"No existing merge request to be cleaned up."}1296gitlab # [ 142.512656] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:28.535Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0204c9b5bdb68960d2419b37","created_at":"2026-08-23T07:12:28.321Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-2e24bff3458542f4","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e6a3cf58c9b4daf1e7816ced4685da18","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:28.337Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0204c9b5bdb68960d2419b37: done: 0.085603 sec","job_status":"done","queue_duration_s":0.112816,"scheduling_latency_s":0.112831,"redis_calls":13,"redis_duration_s":0.019209,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004334,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003143,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.011732,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020621,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000431619,"duration_s":0.085603,"completed_at":"2026-08-23T07:12:28.535Z","load_balancing_strategy":"primary","db_duration_s":0.035872,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1297gitlab # [ 142.514344] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:28.537Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"d68ebb0e1daad9d80578abfb","created_at":"2026-08-23T07:12:28.321Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-2e24bff3458542f4","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e6a3cf58c9b4daf1e7816ced4685da18","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:28.337Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-d68ebb0e1daad9d80578abfb: start","job_status":"start","queue_duration_s":0.19999,"scheduling_latency_s":0.200006}1298gitlab # [ 142.521508] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:28.544Z","message":"No existing merge request to be cleaned up."}1299gitlab # [ 142.527465] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:28.550Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"d68ebb0e1daad9d80578abfb","created_at":"2026-08-23T07:12:28.321Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-2e24bff3458542f4","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e6a3cf58c9b4daf1e7816ced4685da18","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:28.337Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-d68ebb0e1daad9d80578abfb: done: 0.013286 sec","job_status":"done","queue_duration_s":0.19999,"scheduling_latency_s":0.200006,"redis_calls":10,"redis_duration_s":0.001592,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000753,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000839,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008335,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013286,"completed_at":"2026-08-23T07:12:28.550Z","load_balancing_strategy":"primary","db_duration_s":0.001837,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1300gitlab # [ 142.565743] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:28.551Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"605b64a5311092e6cbe95742","created_at":"2026-08-23T07:12:28.321Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-2e24bff3458542f4","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e6a3cf58c9b4daf1e7816ced4685da18","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:28.337Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-605b64a5311092e6cbe95742: start","job_status":"start","queue_duration_s":0.214433,"scheduling_latency_s":0.214447}1301gitlab # [ 142.566594] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:28.558Z","message":"No existing merge request to be cleaned up."}1302gitlab # [ 142.567508] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:28.564Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"605b64a5311092e6cbe95742","created_at":"2026-08-23T07:12:28.321Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-2e24bff3458542f4","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e6a3cf58c9b4daf1e7816ced4685da18","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:28.337Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-605b64a5311092e6cbe95742: done: 0.012756 sec","job_status":"done","queue_duration_s":0.214433,"scheduling_latency_s":0.214447,"redis_calls":10,"redis_duration_s":0.00212,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000824,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001296,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007899,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012756,"completed_at":"2026-08-23T07:12:28.564Z","load_balancing_strategy":"primary","db_duration_s":0.001549,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1303gitlab # [ 142.622784] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:28.565Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ddf7960d387cf8e0633505da","created_at":"2026-08-23T07:12:28.321Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-2e24bff3458542f4","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e6a3cf58c9b4daf1e7816ced4685da18","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:28.337Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ddf7960d387cf8e0633505da: start","job_status":"start","queue_duration_s":0.228419,"scheduling_latency_s":0.228432}1304gitlab # [ 142.623491] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:28.572Z","message":"No existing merge request to be cleaned up."}1305gitlab # [ 142.623992] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:28.578Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ddf7960d387cf8e0633505da","created_at":"2026-08-23T07:12:28.321Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-2e24bff3458542f4","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"e6a3cf58c9b4daf1e7816ced4685da18","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:28.337Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ddf7960d387cf8e0633505da: done: 0.013047 sec","job_status":"done","queue_duration_s":0.228419,"scheduling_latency_s":0.228432,"redis_calls":10,"redis_duration_s":0.002064,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000797,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001267,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007662,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013047,"completed_at":"2026-08-23T07:12:28.578Z","load_balancing_strategy":"primary","db_duration_s":0.001523,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1306gitlab # [ 142.636826] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:28.579Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"d7ae1020db6bf3b6d7851a71","created_at":"2026-08-23T07:12:28.309Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b4ebd3bdb6a6088f94e0f99da188dda5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-23T07:12:28.416Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-d7ae1020db6bf3b6d7851a71: start","job_status":"start","queue_duration_s":0.163658,"scheduling_latency_s":0.163672}1307gitlab # [ 142.676687] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:28.587Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1308gitlab # [ 142.677465] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:28.592Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"d7ae1020db6bf3b6d7851a71","created_at":"2026-08-23T07:12:28.309Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b4ebd3bdb6a6088f94e0f99da188dda5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-23T07:12:28.416Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-d7ae1020db6bf3b6d7851a71: done: 0.013164 sec","job_status":"done","queue_duration_s":0.163658,"scheduling_latency_s":0.163672,"redis_calls":10,"redis_duration_s":0.001799,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000414,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001005,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00038,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007068,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000242769,"duration_s":0.013164,"completed_at":"2026-08-23T07:12:28.592Z","load_balancing_strategy":"primary","db_duration_s":0.000404,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1309gitlab # [ 142.682468] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:28.593Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"e270db5ea9b93963b4e1f126","created_at":"2026-08-23T07:12:28.434Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6f7899b96d835c7d2f68fb996bfe483f","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:28.449Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-e270db5ea9b93963b4e1f126: start","job_status":"start","queue_duration_s":0.144451,"scheduling_latency_s":0.144465}1310gitlab # [ 142.694146] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:28.625Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"e270db5ea9b93963b4e1f126","created_at":"2026-08-23T07:12:28.434Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6f7899b96d835c7d2f68fb996bfe483f","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:28.449Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-e270db5ea9b93963b4e1f126: done: 0.031316 sec","job_status":"done","queue_duration_s":0.144451,"scheduling_latency_s":0.144465,"redis_calls":10,"redis_duration_s":0.003593,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000254,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002598,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000741,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01125,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001006273,"duration_s":0.031316,"completed_at":"2026-08-23T07:12:28.625Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010966,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1311gitlab # [ 142.733869] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:28.627Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"9928033a3db34c60705ca613","created_at":"2026-08-23T07:12:28.460Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8892d66591e501012bb17c820bdeb841","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-23T07:12:28.469Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-9928033a3db34c60705ca613: start","job_status":"start","queue_duration_s":0.157525,"scheduling_latency_s":0.157551}1312gitlab # [ 142.737959] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:28.638Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1313gitlab # [ 142.741225] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:28.643Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"9928033a3db34c60705ca613","created_at":"2026-08-23T07:12:28.460Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8892d66591e501012bb17c820bdeb841","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-23T07:12:28.469Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-9928033a3db34c60705ca613: done: 0.016279 sec","job_status":"done","queue_duration_s":0.157525,"scheduling_latency_s":0.157551,"redis_calls":10,"redis_duration_s":0.001374,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000229,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000826,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000319,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009182,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000218742,"duration_s":0.016279,"completed_at":"2026-08-23T07:12:28.643Z","load_balancing_strategy":"primary","db_duration_s":0.000328,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1314gitlab # [ 142.778454] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:28.644Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"3fb7f06b2954e10c97add233","created_at":"2026-08-23T07:12:28.481Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eafa252453cf6fb23fdb0ca631c84b99","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:28.492Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-3fb7f06b2954e10c97add233: start","job_status":"start","queue_duration_s":0.151605,"scheduling_latency_s":0.151618}1315gitlab # [ 142.784827] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:28.686Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"3fb7f06b2954e10c97add233","created_at":"2026-08-23T07:12:28.481Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eafa252453cf6fb23fdb0ca631c84b99","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:28.492Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-3fb7f06b2954e10c97add233: done: 0.042264 sec","job_status":"done","queue_duration_s":0.151605,"scheduling_latency_s":0.151618,"redis_calls":12,"redis_duration_s":0.0016560000000000001,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000248,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000751,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000657,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024985,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000397536,"exclusive_lock_hold_duration_s":0.020273246999999998,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.042264,"completed_at":"2026-08-23T07:12:28.686Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012214,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1316gitlab # [ 142.827210] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:28.687Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"a0ef522c1164edbf87c8c1ff","created_at":"2026-08-23T07:12:28.503Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4a14b7086dd3e3fda4ed310b6cfc29eb","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:28.513Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-a0ef522c1164edbf87c8c1ff: start","job_status":"start","queue_duration_s":0.174379,"scheduling_latency_s":0.174392}1317gitlab # [ 142.930501] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:28.953Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"a0ef522c1164edbf87c8c1ff","created_at":"2026-08-23T07:12:28.503Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4a14b7086dd3e3fda4ed310b6cfc29eb","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:28.513Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-a0ef522c1164edbf87c8c1ff: done: 0.265778 sec","job_status":"done","queue_duration_s":0.174379,"scheduling_latency_s":0.174392,"redis_calls":565,"redis_duration_s":0.097937,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00027,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001381,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.096286,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.182745,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000351162,"duration_s":0.265778,"completed_at":"2026-08-23T07:12:28.953Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00024,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1318gitlab # [ 142.940319] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:28.963Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"b82704714875ef18b714960b","created_at":"2026-08-23T07:12:28.521Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a85f44716efabc083e8c88e3808a210a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:28.530Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-b82704714875ef18b714960b: start","job_status":"start","queue_duration_s":0.432563,"scheduling_latency_s":0.432579}1319gitlab # [ 142.954454] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:28.977Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"b82704714875ef18b714960b","created_at":"2026-08-23T07:12:28.521Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a85f44716efabc083e8c88e3808a210a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:28.530Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-b82704714875ef18b714960b: done: 0.01401 sec","job_status":"done","queue_duration_s":0.432563,"scheduling_latency_s":0.432579,"redis_calls":12,"redis_duration_s":0.0014680000000000001,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000245,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000678,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000545,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007296,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000196953,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.01401,"completed_at":"2026-08-23T07:12:28.977Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000375,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1320gitlab # [ 142.998914] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:28.978Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"03d62981e86d22383da6c8df","created_at":"2026-08-23T07:12:28.616Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ffadb76e50872a2359c326a67858318d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:28.888Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-03d62981e86d22383da6c8df: start","job_status":"start","queue_duration_s":0.089863,"scheduling_latency_s":0.089875}1321gitlab # [ 142.999537] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:28.992Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"03d62981e86d22383da6c8df","created_at":"2026-08-23T07:12:28.616Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ffadb76e50872a2359c326a67858318d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:28.888Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-03d62981e86d22383da6c8df: done: 0.013644 sec","job_status":"done","queue_duration_s":0.089863,"scheduling_latency_s":0.089875,"redis_calls":10,"redis_duration_s":0.001271,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00025,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000763,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000258,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000196115,"duration_s":0.013644,"completed_at":"2026-08-23T07:12:28.992Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001705,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1322gitlab # [ 143.039084] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:28.993Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"415bbfab08235686bb49348a","created_at":"2026-08-23T07:12:28.894Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cca43b7c8b359c34a8de1271a6b48d1d","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:28.901Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-415bbfab08235686bb49348a: start","job_status":"start","queue_duration_s":0.091816,"scheduling_latency_s":0.091829}1323gitlab # [ 143.039630] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:29.014Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"415bbfab08235686bb49348a","created_at":"2026-08-23T07:12:28.894Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cca43b7c8b359c34a8de1271a6b48d1d","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:28.901Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-415bbfab08235686bb49348a: done: 0.021666 sec","job_status":"done","queue_duration_s":0.091816,"scheduling_latency_s":0.091829,"redis_calls":10,"redis_duration_s":0.001211,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000239,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00074,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000232,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009291,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000194718,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.021666,"completed_at":"2026-08-23T07:12:29.014Z","load_balancing_strategy":"primary","db_duration_s":0.007948,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1324gitlab # [ 143.067615] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:29.015Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"a29b607c24f9472d329e0e6f","created_at":"2026-08-23T07:12:28.905Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fd9d84b08eaebf6b6640ddd8f9261768","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:28.909Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-a29b607c24f9472d329e0e6f: start","job_status":"start","queue_duration_s":0.105589,"scheduling_latency_s":0.105602}1325gitlab # [ 143.111679] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:29.022Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1326gitlab # [ 143.112418] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:29.027Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"a29b607c24f9472d329e0e6f","created_at":"2026-08-23T07:12:28.905Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fd9d84b08eaebf6b6640ddd8f9261768","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:28.909Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-a29b607c24f9472d329e0e6f: done: 0.012244 sec","job_status":"done","queue_duration_s":0.105589,"scheduling_latency_s":0.105602,"redis_calls":10,"redis_duration_s":0.0013549999999999999,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000265,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000717,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000373,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00681,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000240254,"duration_s":0.012244,"completed_at":"2026-08-23T07:12:29.027Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000266,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1327gitlab # [ 143.115780] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:29.028Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"cb2be6a1380824452170a41e","created_at":"2026-08-23T07:12:28.913Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"16881d0033d15875ca4b923fcafa9ec4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:28.918Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-cb2be6a1380824452170a41e: start","job_status":"start","queue_duration_s":0.110639,"scheduling_latency_s":0.110652}1328gitlab # [ 143.127552] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:29.035Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1329gitlab # [ 143.130148] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:29.040Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"cb2be6a1380824452170a41e","created_at":"2026-08-23T07:12:28.913Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"16881d0033d15875ca4b923fcafa9ec4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:28.918Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-cb2be6a1380824452170a41e: done: 0.011871 sec","job_status":"done","queue_duration_s":0.110639,"scheduling_latency_s":0.110652,"redis_calls":10,"redis_duration_s":0.0011560000000000001,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000248,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000684,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000224,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006847,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000224051,"duration_s":0.011871,"completed_at":"2026-08-23T07:12:29.040Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000254,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1330gitlab # [ 143.172562] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:29.041Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"b68d617caef8aca3cd13e737","created_at":"2026-08-23T07:12:28.924Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6e5aa7a8faf811054680076c73d5a293","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:28.928Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-b68d617caef8aca3cd13e737: start","job_status":"start","queue_duration_s":0.112683,"scheduling_latency_s":0.112696}1331gitlab # [ 143.174568] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:29.053Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"b68d617caef8aca3cd13e737","created_at":"2026-08-23T07:12:28.924Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6e5aa7a8faf811054680076c73d5a293","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:28.928Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-b68d617caef8aca3cd13e737: done: 0.01241 sec","job_status":"done","queue_duration_s":0.112683,"scheduling_latency_s":0.112696,"redis_calls":12,"redis_duration_s":0.001394,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000279,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000218,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000676,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000221,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00712,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000206451,"duration_s":0.01241,"completed_at":"2026-08-23T07:12:29.053Z","load_balancing_strategy":"primary","db_duration_s":0.000227,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1332gitlab # [ 143.216321] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:29.054Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"b5ebd5d2b0724703e9d97a57","created_at":"2026-08-23T07:12:28.934Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ac89d0bec33ff2ebcd3dbc0fde545d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:28.938Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-b5ebd5d2b0724703e9d97a57: start","job_status":"start","queue_duration_s":0.116425,"scheduling_latency_s":0.116437}1333gitlab # [ 143.286730] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:29.309Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"b5ebd5d2b0724703e9d97a57","created_at":"2026-08-23T07:12:28.934Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ac89d0bec33ff2ebcd3dbc0fde545d4f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:28.938Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-b5ebd5d2b0724703e9d97a57: done: 0.254546 sec","job_status":"done","queue_duration_s":0.116425,"scheduling_latency_s":0.116437,"redis_calls":14,"redis_duration_s":0.002798,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000487,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001227,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001084,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000351441,"exclusive_lock_hold_duration_s":0.230875432,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.254546,"completed_at":"2026-08-23T07:12:29.309Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.222082,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1334gitlab # [ 143.325064] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:29.347Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"4c3a3e8b3e51879506844681","created_at":"2026-08-23T07:12:28.944Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"59d52384f6623cb5321d266c845ddcfb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:28.948Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-4c3a3e8b3e51879506844681: start","job_status":"start","queue_duration_s":0.398969,"scheduling_latency_s":0.399005}1335gitlab # [ 143.492578] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:29.515Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"4c3a3e8b3e51879506844681","created_at":"2026-08-23T07:12:28.944Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"59d52384f6623cb5321d266c845ddcfb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:28.948Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-4c3a3e8b3e51879506844681: done: 0.167538 sec","job_status":"done","queue_duration_s":0.398969,"scheduling_latency_s":0.399005,"redis_calls":14,"redis_duration_s":0.004261,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001599,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001443,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001219,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.035,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.035,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.114899,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000672432,"exclusive_lock_hold_duration_s":0.138192983,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.167538,"completed_at":"2026-08-23T07:12:29.515Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.051136,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1336gitlab # [ 143.569456] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:29.592Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"fddfc5560e276dbd3bc2ebda","created_at":"2026-08-23T07:12:28.961Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"258c8025615fc543d6c87d290576d927","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:29.097Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-fddfc5560e276dbd3bc2ebda: start","job_status":"start","queue_duration_s":0.495151,"scheduling_latency_s":0.495179}1337gitlab # [ 143.597401] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:29.620Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1338gitlab # [ 143.609581] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:29.632Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"fddfc5560e276dbd3bc2ebda","created_at":"2026-08-23T07:12:28.961Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"258c8025615fc543d6c87d290576d927","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:29.097Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-fddfc5560e276dbd3bc2ebda: done: 0.040051 sec","job_status":"done","queue_duration_s":0.495151,"scheduling_latency_s":0.495179,"redis_calls":10,"redis_duration_s":0.002664,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000456,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001622,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000586,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017531,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00055454,"duration_s":0.040051,"completed_at":"2026-08-23T07:12:29.632Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00081,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1339gitlab # [ 143.645528] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:29.668Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"69e3aa06b8f79fab4ee095c0","created_at":"2026-08-23T07:12:29.119Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d7a1e922a81cbf5f3488e548038e2add","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:29.122Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-69e3aa06b8f79fab4ee095c0: start","job_status":"start","queue_duration_s":0.54542,"scheduling_latency_s":0.545451}1340gitlab # [ 143.691146] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:29.713Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"69e3aa06b8f79fab4ee095c0","created_at":"2026-08-23T07:12:29.119Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d7a1e922a81cbf5f3488e548038e2add","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:29.122Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-69e3aa06b8f79fab4ee095c0: done: 0.04553 sec","job_status":"done","queue_duration_s":0.54542,"scheduling_latency_s":0.545451,"redis_calls":10,"redis_duration_s":0.002331,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000439,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001378,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000514,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020813,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000388877,"duration_s":0.04553,"completed_at":"2026-08-23T07:12:29.713Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003536,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1341gitlab # [ 143.726733] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:29.749Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"580bff9b905ae50c4c8372e4","created_at":"2026-08-23T07:12:29.125Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b51dfb6d0b869938ee636384073448f3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:29.128Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-580bff9b905ae50c4c8372e4: start","job_status":"start","queue_duration_s":0.621404,"scheduling_latency_s":0.621437}1342gitlab # [ 143.758558] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:29.781Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1343gitlab # [ 143.771333] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:29.793Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"580bff9b905ae50c4c8372e4","created_at":"2026-08-23T07:12:29.125Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b51dfb6d0b869938ee636384073448f3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:29.128Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-580bff9b905ae50c4c8372e4: done: 0.044168 sec","job_status":"done","queue_duration_s":0.621404,"scheduling_latency_s":0.621437,"redis_calls":10,"redis_duration_s":0.003368,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000711,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001898,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000759,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017819,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000554819,"duration_s":0.044168,"completed_at":"2026-08-23T07:12:29.793Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000768,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344gitlab # [ 143.806762] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:29.829Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"181a21a461861201c0784372","created_at":"2026-08-23T07:12:29.134Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"542e8085da3ad55bca6e33ffef67fd11","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:29.139Z","job_size_bytes":3,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-181a21a461861201c0784372: start","job_status":"start","queue_duration_s":0.689859,"scheduling_latency_s":0.689891}1345gitlab # [ 143.846835] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:29.869Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"181a21a461861201c0784372","created_at":"2026-08-23T07:12:29.134Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"542e8085da3ad55bca6e33ffef67fd11","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:29.139Z","job_size_bytes":3,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-181a21a461861201c0784372: done: 0.039947 sec","job_status":"done","queue_duration_s":0.689859,"scheduling_latency_s":0.689891,"redis_calls":10,"redis_duration_s":0.002536,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00042,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001666,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00045,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018134,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000463187,"duration_s":0.039947,"completed_at":"2026-08-23T07:12:29.869Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000837,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1346gitlab # [ 143.882195] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:29.905Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"62cc472ae92f77f5f051abfb","created_at":"2026-08-23T07:12:29.142Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ad4356fbd9a31863f7128fe4a50efa55","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-23T07:12:29.145Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-62cc472ae92f77f5f051abfb: start","job_status":"start","queue_duration_s":0.759411,"scheduling_latency_s":0.759443}1347gitlab # [ 143.932671] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:29.955Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"62cc472ae92f77f5f051abfb","created_at":"2026-08-23T07:12:29.142Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ad4356fbd9a31863f7128fe4a50efa55","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-23T07:12:29.145Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-62cc472ae92f77f5f051abfb: done: 0.05043 sec","job_status":"done","queue_duration_s":0.759411,"scheduling_latency_s":0.759443,"redis_calls":10,"redis_duration_s":0.00251,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000548,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001563,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000399,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025905,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000327137,"duration_s":0.05043,"completed_at":"2026-08-23T07:12:29.955Z","load_balancing_strategy":"primary","db_duration_s":0.004233,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1348gitlab # [ 143.967510] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:29.990Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"272885f54b49800c38c7a9e5","created_at":"2026-08-23T07:12:29.147Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"62cc61e6d3f06ffff549059b518d2b9b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:29.150Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-272885f54b49800c38c7a9e5: start","job_status":"start","queue_duration_s":0.839777,"scheduling_latency_s":0.839825}1349gitlab # [ 144.019421] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.041Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"272885f54b49800c38c7a9e5","created_at":"2026-08-23T07:12:29.147Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"62cc61e6d3f06ffff549059b518d2b9b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:29.150Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-272885f54b49800c38c7a9e5: done: 0.051458 sec","job_status":"done","queue_duration_s":0.839777,"scheduling_latency_s":0.839825,"redis_calls":12,"redis_duration_s":0.003847,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000617,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001789,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001441,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023106,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000771886,"exclusive_lock_hold_duration_s":0.008444089,"duration_s":0.051458,"completed_at":"2026-08-23T07:12:30.041Z","load_balancing_strategy":"primary","db_duration_s":0.003992,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1350gitlab # [ 144.056843] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.079Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"dc56fbd73d4c026c4673f418","created_at":"2026-08-23T07:12:29.155Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"34248225a4c50e235ce4b34ca93afcad","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:29.158Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-dc56fbd73d4c026c4673f418: start","job_status":"start","queue_duration_s":0.920906,"scheduling_latency_s":0.920936}1351gitlab # [ 144.110155] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.132Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"dc56fbd73d4c026c4673f418","created_at":"2026-08-23T07:12:29.155Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"34248225a4c50e235ce4b34ca93afcad","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:29.158Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-dc56fbd73d4c026c4673f418: done: 0.052613 sec","job_status":"done","queue_duration_s":0.920906,"scheduling_latency_s":0.920936,"redis_calls":12,"redis_duration_s":0.004463,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000827,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002042,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001594,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023236,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000865473,"exclusive_lock_hold_duration_s":0.006676827,"duration_s":0.052613,"completed_at":"2026-08-23T07:12:30.132Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003298,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 144.153920] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.176Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"4a274d6c12a95a54dd27e860","created_at":"2026-08-23T07:12:29.161Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5e35a1c72754df7a3f2f6ad616aa0d44","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:29.164Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-4a274d6c12a95a54dd27e860: start","job_status":"start","queue_duration_s":1.011996,"scheduling_latency_s":1.012046}1353gitlab # [ 144.198419] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.220Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"4a274d6c12a95a54dd27e860","created_at":"2026-08-23T07:12:29.161Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5e35a1c72754df7a3f2f6ad616aa0d44","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:29.164Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-4a274d6c12a95a54dd27e860: done: 0.044663 sec","job_status":"done","queue_duration_s":1.011996,"scheduling_latency_s":1.012046,"redis_calls":12,"redis_duration_s":0.003287,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00046,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001494,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001333,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020189,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000727746,"exclusive_lock_hold_duration_s":0.004991695,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.044663,"completed_at":"2026-08-23T07:12:30.220Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002311,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1354gitlab # [ 144.218660] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.223Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"06272508df10b80e6edda10a","created_at":"2026-08-23T07:12:29.168Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:29.171Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-06272508df10b80e6edda10a: start","job_status":"start","queue_duration_s":1.052299,"scheduling_latency_s":1.052336}1355gitlab # [ 144.356848] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.379Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"06272508df10b80e6edda10a","created_at":"2026-08-23T07:12:29.168Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:29.171Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-06272508df10b80e6edda10a: done: 0.156001 sec","job_status":"done","queue_duration_s":1.052299,"scheduling_latency_s":1.052336,"redis_calls":71,"redis_duration_s":0.046424,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.00247,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001105,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.015213,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.027636,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.106013,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000306464,"duration_s":0.156001,"completed_at":"2026-08-23T07:12:30.379Z","load_balancing_strategy":"primary","db_duration_s":0.003116,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356gitlab # [ 144.429525] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.452Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"f2e8f8a6c48a29b89706d96d","created_at":"2026-08-23T07:12:29.175Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7e0fea834d1542e539d725b9215265fb","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:29.178Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-f2e8f8a6c48a29b89706d96d: start","job_status":"start","queue_duration_s":1.273544,"scheduling_latency_s":1.273588}1357gitlab # [ 144.485637] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.508Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"f2e8f8a6c48a29b89706d96d","created_at":"2026-08-23T07:12:29.175Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7e0fea834d1542e539d725b9215265fb","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:29.178Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-f2e8f8a6c48a29b89706d96d: done: 0.056207 sec","job_status":"done","queue_duration_s":1.273544,"scheduling_latency_s":1.273588,"redis_calls":16,"redis_duration_s":0.004025,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001709,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001768,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000548,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027446,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000467657,"duration_s":0.056207,"completed_at":"2026-08-23T07:12:30.508Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006857,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358gitlab # [ 144.536815] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.559Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"52df6c89ac488c44583efe98","created_at":"2026-08-23T07:12:29.180Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0cbadec6c99d9df216b832106f4b6f74","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:29.183Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-52df6c89ac488c44583efe98: start","job_status":"start","queue_duration_s":1.37606,"scheduling_latency_s":1.376102}1359gitlab # [ 144.582414] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.604Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"52df6c89ac488c44583efe98","created_at":"2026-08-23T07:12:29.180Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0cbadec6c99d9df216b832106f4b6f74","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:29.183Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-52df6c89ac488c44583efe98: done: 0.045338 sec","job_status":"done","queue_duration_s":1.37606,"scheduling_latency_s":1.376102,"redis_calls":13,"redis_duration_s":0.004052999999999999,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000619,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002106,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001328,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028205,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.013370973999999999,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.045338,"completed_at":"2026-08-23T07:12:30.604Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00377,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1360gitlab # [ 144.626419] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.649Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"734b8f43a11136d662c43f9f","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-734b8f43a11136d662c43f9f: start","job_status":"start","queue_duration_s":0.277517,"scheduling_latency_s":0.277546}1361gitlab # [ 144.659985] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.682Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"734b8f43a11136d662c43f9f","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-734b8f43a11136d662c43f9f: done: 0.033537 sec","job_status":"done","queue_duration_s":0.277517,"scheduling_latency_s":0.277546,"redis_calls":16,"redis_duration_s":0.006842,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000496,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001301,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005045,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012264,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000449499,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033537,"completed_at":"2026-08-23T07:12:30.682Z","load_balancing_strategy":"primary","db_duration_s":0.000606,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1362gitlab # [ 144.695435] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.718Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5211ffeaef5c93d81cf0e37d","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5211ffeaef5c93d81cf0e37d: start","job_status":"start","queue_duration_s":0.346556,"scheduling_latency_s":0.346595}1363gitlab # [ 144.726147] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.748Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5211ffeaef5c93d81cf0e37d","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5211ffeaef5c93d81cf0e37d: done: 0.030924 sec","job_status":"done","queue_duration_s":0.346556,"scheduling_latency_s":0.346595,"redis_calls":13,"redis_duration_s":0.002346,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000817,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001529,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015506,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030924,"completed_at":"2026-08-23T07:12:30.748Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1364gitlab # [ 144.759645] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.782Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"17e21612b4b255c2fad9db69","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-17e21612b4b255c2fad9db69: start","job_status":"start","queue_duration_s":0.410318,"scheduling_latency_s":0.410356}1365gitlab # [ 144.783621] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.806Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"17e21612b4b255c2fad9db69","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-17e21612b4b255c2fad9db69: done: 0.02437 sec","job_status":"done","queue_duration_s":0.410318,"scheduling_latency_s":0.410356,"redis_calls":13,"redis_duration_s":0.00409,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001254,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002836,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015226,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02437,"completed_at":"2026-08-23T07:12:30.806Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1366gitlab # [ 144.786823] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.809Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"50850942d8e1604c16b78ec7","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-50850942d8e1604c16b78ec7: start","job_status":"start","queue_duration_s":0.438104,"scheduling_latency_s":0.438134}1367gitlab # [ 144.807301] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.830Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"50850942d8e1604c16b78ec7","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-50850942d8e1604c16b78ec7: done: 0.020344 sec","job_status":"done","queue_duration_s":0.438104,"scheduling_latency_s":0.438134,"redis_calls":13,"redis_duration_s":0.0034270000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001182,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002245,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012606,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020344,"completed_at":"2026-08-23T07:12:30.830Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368gitlab # [ 144.821976] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.831Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f514c075b343412e2f641a04","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f514c075b343412e2f641a04: start","job_status":"start","queue_duration_s":0.460044,"scheduling_latency_s":0.460069}1369gitlab # [ 144.832807] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.843Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f514c075b343412e2f641a04","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f514c075b343412e2f641a04: done: 0.011456 sec","job_status":"done","queue_duration_s":0.460044,"scheduling_latency_s":0.460069,"redis_calls":13,"redis_duration_s":0.001558,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000498,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00106,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006442,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011456,"completed_at":"2026-08-23T07:12:30.843Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1370gitlab # [ 144.874742] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.844Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41f4f69a0ece8b925aac5d6f","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41f4f69a0ece8b925aac5d6f: start","job_status":"start","queue_duration_s":0.472283,"scheduling_latency_s":0.472297}1371gitlab # [ 144.875533] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.853Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41f4f69a0ece8b925aac5d6f","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41f4f69a0ece8b925aac5d6f: done: 0.009679 sec","job_status":"done","queue_duration_s":0.472283,"scheduling_latency_s":0.472297,"redis_calls":13,"redis_duration_s":0.001487,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000494,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006047,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009679,"completed_at":"2026-08-23T07:12:30.853Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1372gitlab # [ 144.928261] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.854Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"567948645dfd3a997de37fc1","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-567948645dfd3a997de37fc1: start","job_status":"start","queue_duration_s":0.482774,"scheduling_latency_s":0.482786}1373gitlab # [ 144.929384] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.863Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"567948645dfd3a997de37fc1","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-567948645dfd3a997de37fc1: done: 0.009356 sec","job_status":"done","queue_duration_s":0.482774,"scheduling_latency_s":0.482786,"redis_calls":13,"redis_duration_s":0.0014910000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000977,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006044,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009356,"completed_at":"2026-08-23T07:12:30.863Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1374gitlab # [ 144.950872] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.864Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7df7189d6a17ab7cbef304c6","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7df7189d6a17ab7cbef304c6: start","job_status":"start","queue_duration_s":0.493092,"scheduling_latency_s":0.493104}1375gitlab # [ 144.959669] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.874Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7df7189d6a17ab7cbef304c6","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7df7189d6a17ab7cbef304c6: done: 0.009373 sec","job_status":"done","queue_duration_s":0.493092,"scheduling_latency_s":0.493104,"redis_calls":13,"redis_duration_s":0.001546,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000491,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001055,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006046,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009373,"completed_at":"2026-08-23T07:12:30.874Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1376gitlab # [ 145.002873] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.875Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"033f5a611307d4b0742a9176","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-033f5a611307d4b0742a9176: start","job_status":"start","queue_duration_s":0.503414,"scheduling_latency_s":0.503427}1377gitlab # [ 145.003528] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.884Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"033f5a611307d4b0742a9176","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-033f5a611307d4b0742a9176: done: 0.009632 sec","job_status":"done","queue_duration_s":0.503414,"scheduling_latency_s":0.503427,"redis_calls":13,"redis_duration_s":0.001733,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001223,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00626,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009632,"completed_at":"2026-08-23T07:12:30.884Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1378gitlab # [ 145.041103] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.885Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a403f4763c4cad5e13bc0907","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a403f4763c4cad5e13bc0907: start","job_status":"start","queue_duration_s":0.514117,"scheduling_latency_s":0.51413}1379gitlab # [ 145.041697] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.895Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a403f4763c4cad5e13bc0907","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a403f4763c4cad5e13bc0907: done: 0.00936 sec","job_status":"done","queue_duration_s":0.514117,"scheduling_latency_s":0.51413,"redis_calls":13,"redis_duration_s":0.00149,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000483,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001007,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006198,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00936,"completed_at":"2026-08-23T07:12:30.895Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1380gitlab # [ 145.071829] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.896Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f568b85369c5e29f26e9385","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f568b85369c5e29f26e9385: start","job_status":"start","queue_duration_s":0.52445,"scheduling_latency_s":0.524462}1381gitlab # [ 145.108087] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.905Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f568b85369c5e29f26e9385","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f568b85369c5e29f26e9385: done: 0.009372 sec","job_status":"done","queue_duration_s":0.52445,"scheduling_latency_s":0.524462,"redis_calls":13,"redis_duration_s":0.001512,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000492,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00102,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006207,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009372,"completed_at":"2026-08-23T07:12:30.905Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1382gitlab # [ 145.112675] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.906Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4f0fa94c639d7cc4caba6bc1","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4f0fa94c639d7cc4caba6bc1: start","job_status":"start","queue_duration_s":0.534795,"scheduling_latency_s":0.534808}1383gitlab # [ 145.122676] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.917Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4f0fa94c639d7cc4caba6bc1","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4f0fa94c639d7cc4caba6bc1: done: 0.011302 sec","job_status":"done","queue_duration_s":0.534795,"scheduling_latency_s":0.534808,"redis_calls":13,"redis_duration_s":0.001529,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000489,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006325,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011302,"completed_at":"2026-08-23T07:12:30.917Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1384gitlab # [ 145.173468] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.918Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6a35b081213f246166efabd","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6a35b081213f246166efabd: start","job_status":"start","queue_duration_s":0.54718,"scheduling_latency_s":0.547193}1385gitlab # [ 145.174082] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.928Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6a35b081213f246166efabd","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6a35b081213f246166efabd: done: 0.009449 sec","job_status":"done","queue_duration_s":0.54718,"scheduling_latency_s":0.547193,"redis_calls":13,"redis_duration_s":0.001513,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001002,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006087,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009449,"completed_at":"2026-08-23T07:12:30.928Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1386gitlab # [ 145.210163] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.929Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a0d363cde222d5823ffd2e79","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a0d363cde222d5823ffd2e79: start","job_status":"start","queue_duration_s":0.557591,"scheduling_latency_s":0.557604}1387gitlab # [ 145.210841] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.938Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a0d363cde222d5823ffd2e79","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a0d363cde222d5823ffd2e79: done: 0.009397 sec","job_status":"done","queue_duration_s":0.557591,"scheduling_latency_s":0.557604,"redis_calls":13,"redis_duration_s":0.001539,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001033,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006192,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009397,"completed_at":"2026-08-23T07:12:30.938Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1388gitlab # [ 145.264883] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.939Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"baf2abd811ef641eac65dea2","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-baf2abd811ef641eac65dea2: start","job_status":"start","queue_duration_s":0.567937,"scheduling_latency_s":0.567949}1389gitlab # [ 145.265511] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.949Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"baf2abd811ef641eac65dea2","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-baf2abd811ef641eac65dea2: done: 0.009425 sec","job_status":"done","queue_duration_s":0.567937,"scheduling_latency_s":0.567949,"redis_calls":13,"redis_duration_s":0.001574,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001066,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006241,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009425,"completed_at":"2026-08-23T07:12:30.949Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1390gitlab # [ 145.309830] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.950Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b54cf3a02989c5690ae74555","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b54cf3a02989c5690ae74555: start","job_status":"start","queue_duration_s":0.578352,"scheduling_latency_s":0.578365}1391gitlab # [ 145.310508] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.959Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b54cf3a02989c5690ae74555","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b54cf3a02989c5690ae74555: done: 0.009591 sec","job_status":"done","queue_duration_s":0.578352,"scheduling_latency_s":0.578365,"redis_calls":13,"redis_duration_s":0.0014689999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000486,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000983,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006217,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009591,"completed_at":"2026-08-23T07:12:30.959Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 145.317159] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.960Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86a30235a3d08b0ab59f3190","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86a30235a3d08b0ab59f3190: start","job_status":"start","queue_duration_s":0.588902,"scheduling_latency_s":0.588916}1393gitlab # [ 145.355643] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:30.970Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86a30235a3d08b0ab59f3190","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86a30235a3d08b0ab59f3190: done: 0.009436 sec","job_status":"done","queue_duration_s":0.588902,"scheduling_latency_s":0.588916,"redis_calls":13,"redis_duration_s":0.0015500000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001025,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006244,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009436,"completed_at":"2026-08-23T07:12:30.970Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 145.394920] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:31.417Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c129e8e945bd16ab3ce4216e","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c129e8e945bd16ab3ce4216e: start","job_status":"start","queue_duration_s":1.046099,"scheduling_latency_s":1.046129}1395gitlab # [ 145.423110] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:31.445Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c129e8e945bd16ab3ce4216e","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c129e8e945bd16ab3ce4216e: done: 0.027996 sec","job_status":"done","queue_duration_s":1.046099,"scheduling_latency_s":1.046129,"redis_calls":13,"redis_duration_s":0.002378,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000866,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001512,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012802,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027996,"completed_at":"2026-08-23T07:12:31.445Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396gitlab # [ 145.455561] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:31.478Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa72df41f98afa049d2b43bb","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa72df41f98afa049d2b43bb: start","job_status":"start","queue_duration_s":1.106927,"scheduling_latency_s":1.106948}1397gitlab # [ 145.487723] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:31.510Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa72df41f98afa049d2b43bb","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa72df41f98afa049d2b43bb: done: 0.031686 sec","job_status":"done","queue_duration_s":1.106927,"scheduling_latency_s":1.106948,"redis_calls":13,"redis_duration_s":0.002426,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000781,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001645,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014398,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031686,"completed_at":"2026-08-23T07:12:31.510Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398gitlab # [ 145.520339] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:31.543Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9ae19be19b500c6ead418eb9","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9ae19be19b500c6ead418eb9: start","job_status":"start","queue_duration_s":1.17161,"scheduling_latency_s":1.17163}1399gitlab # [ 145.552101] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:31.574Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9ae19be19b500c6ead418eb9","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9ae19be19b500c6ead418eb9: done: 0.031392 sec","job_status":"done","queue_duration_s":1.17161,"scheduling_latency_s":1.17163,"redis_calls":13,"redis_duration_s":0.0024850000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000856,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001629,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014181,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031392,"completed_at":"2026-08-23T07:12:31.574Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400gitlab # [ 145.584941] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:31.607Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ba248536af7fa2e3fcd5fb9","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ba248536af7fa2e3fcd5fb9: start","job_status":"start","queue_duration_s":1.236076,"scheduling_latency_s":1.236111}1401gitlab # [ 145.615568] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:31.638Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ba248536af7fa2e3fcd5fb9","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ba248536af7fa2e3fcd5fb9: done: 0.030445 sec","job_status":"done","queue_duration_s":1.236076,"scheduling_latency_s":1.236111,"redis_calls":13,"redis_duration_s":0.002362,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000769,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001593,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030445,"completed_at":"2026-08-23T07:12:31.638Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402gitlab # [ 145.649737] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:31.672Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"976a592ccbad31e96bcd30fd","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-976a592ccbad31e96bcd30fd: start","job_status":"start","queue_duration_s":1.300935,"scheduling_latency_s":1.300965}1403gitlab # [ 145.685766] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:31.708Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"976a592ccbad31e96bcd30fd","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-976a592ccbad31e96bcd30fd: done: 0.035392 sec","job_status":"done","queue_duration_s":1.300935,"scheduling_latency_s":1.300965,"redis_calls":13,"redis_duration_s":0.002688,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000916,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001772,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016222,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035392,"completed_at":"2026-08-23T07:12:31.707Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 145.718751] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:31.741Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fe52df6dca71c7f7f7123727","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fe52df6dca71c7f7f7123727: start","job_status":"start","queue_duration_s":1.369682,"scheduling_latency_s":1.369734}1405gitlab # [ 145.751221] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:31.773Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fe52df6dca71c7f7f7123727","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fe52df6dca71c7f7f7123727: done: 0.032168 sec","job_status":"done","queue_duration_s":1.369682,"scheduling_latency_s":1.369734,"redis_calls":13,"redis_duration_s":0.002642,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000862,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00178,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015947,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032168,"completed_at":"2026-08-23T07:12:31.773Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 145.784452] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:31.807Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6e8ff599eff6d5b0204eb0d","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6e8ff599eff6d5b0204eb0d: start","job_status":"start","queue_duration_s":1.435587,"scheduling_latency_s":1.435625}1407gitlab # [ 145.817352] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:31.839Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6e8ff599eff6d5b0204eb0d","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6e8ff599eff6d5b0204eb0d: done: 0.03236 sec","job_status":"done","queue_duration_s":1.435587,"scheduling_latency_s":1.435625,"redis_calls":13,"redis_duration_s":0.002691,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000899,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001792,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01626,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03236,"completed_at":"2026-08-23T07:12:31.839Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408gitlab # [ 145.850453] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:31.873Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f4d8d6ce9f978879a326783","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f4d8d6ce9f978879a326783: start","job_status":"start","queue_duration_s":1.501627,"scheduling_latency_s":1.501655}1409gitlab # [ 145.886300] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:31.907Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f4d8d6ce9f978879a326783","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f4d8d6ce9f978879a326783: done: 0.034551 sec","job_status":"done","queue_duration_s":1.501627,"scheduling_latency_s":1.501655,"redis_calls":13,"redis_duration_s":0.0027229999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000982,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001741,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016487,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034551,"completed_at":"2026-08-23T07:12:31.907Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410gitlab # [ 145.919197] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:31.942Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"100c8704be5e1bc05941dba1","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-100c8704be5e1bc05941dba1: start","job_status":"start","queue_duration_s":1.570494,"scheduling_latency_s":1.570518}1411gitlab # [ 145.954766] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:31.977Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"100c8704be5e1bc05941dba1","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-100c8704be5e1bc05941dba1: done: 0.035169 sec","job_status":"done","queue_duration_s":1.570494,"scheduling_latency_s":1.570518,"redis_calls":13,"redis_duration_s":0.0029620000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001174,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001788,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016637,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035169,"completed_at":"2026-08-23T07:12:31.977Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1412gitlab # [ 145.988073] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.010Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"058e966fe356a1d7f0e7f1aa","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-058e966fe356a1d7f0e7f1aa: start","job_status":"start","queue_duration_s":1.639084,"scheduling_latency_s":1.639121}1413gitlab # [ 146.020300] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.042Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"058e966fe356a1d7f0e7f1aa","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-058e966fe356a1d7f0e7f1aa: done: 0.032111 sec","job_status":"done","queue_duration_s":1.639084,"scheduling_latency_s":1.639121,"redis_calls":13,"redis_duration_s":0.002683,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00097,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001713,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016446,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032111,"completed_at":"2026-08-23T07:12:32.042Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1414gitlab # [ 146.055682] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.078Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"951ab1f1272546a9807ffdb0","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-951ab1f1272546a9807ffdb0: start","job_status":"start","queue_duration_s":1.706903,"scheduling_latency_s":1.706938}1415gitlab # [ 146.083267] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.106Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"951ab1f1272546a9807ffdb0","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-951ab1f1272546a9807ffdb0: done: 0.027513 sec","job_status":"done","queue_duration_s":1.706903,"scheduling_latency_s":1.706938,"redis_calls":13,"redis_duration_s":0.0025729999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001519,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012523,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027513,"completed_at":"2026-08-23T07:12:32.106Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1416gitlab # [ 146.116630] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.139Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac932f57bacc4a844b91edac","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac932f57bacc4a844b91edac: start","job_status":"start","queue_duration_s":1.76751,"scheduling_latency_s":1.767537}1417gitlab # [ 146.144296] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.167Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac932f57bacc4a844b91edac","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac932f57bacc4a844b91edac: done: 0.02793 sec","job_status":"done","queue_duration_s":1.76751,"scheduling_latency_s":1.767537,"redis_calls":13,"redis_duration_s":0.002286,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000747,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001539,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01292,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02793,"completed_at":"2026-08-23T07:12:32.167Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1418gitlab # [ 146.177449] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.200Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8a8c8b79ef9cb8b572b37b4","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8a8c8b79ef9cb8b572b37b4: start","job_status":"start","queue_duration_s":1.828529,"scheduling_latency_s":1.828562}1419gitlab # [ 146.209160] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.231Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8a8c8b79ef9cb8b572b37b4","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8a8c8b79ef9cb8b572b37b4: done: 0.031563 sec","job_status":"done","queue_duration_s":1.828529,"scheduling_latency_s":1.828562,"redis_calls":13,"redis_duration_s":0.002914,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000907,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002007,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01588,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031563,"completed_at":"2026-08-23T07:12:32.231Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1420gitlab # [ 146.242570] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.265Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f5a3a0b2e9d6d2295aa43bd","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f5a3a0b2e9d6d2295aa43bd: start","job_status":"start","queue_duration_s":1.893859,"scheduling_latency_s":1.893886}1421gitlab # [ 146.267244] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.289Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f5a3a0b2e9d6d2295aa43bd","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f5a3a0b2e9d6d2295aa43bd: done: 0.024166 sec","job_status":"done","queue_duration_s":1.893859,"scheduling_latency_s":1.893886,"redis_calls":13,"redis_duration_s":0.002652,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000829,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001823,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007283,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024166,"completed_at":"2026-08-23T07:12:32.289Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1422gitlab # [ 146.268751] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.290Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d275c74b1bb71e3707d3fbe0","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d275c74b1bb71e3707d3fbe0: start","job_status":"start","queue_duration_s":1.918997,"scheduling_latency_s":1.919011}1423gitlab # [ 146.318970] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.341Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d275c74b1bb71e3707d3fbe0","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d275c74b1bb71e3707d3fbe0: done: 0.0512 sec","job_status":"done","queue_duration_s":1.918997,"scheduling_latency_s":1.919011,"redis_calls":13,"redis_duration_s":0.00164,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00109,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007028,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0512,"completed_at":"2026-08-23T07:12:32.341Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1424gitlab # [ 146.351493] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.374Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f29cba2208bbb8743ccbda9","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f29cba2208bbb8743ccbda9: start","job_status":"start","queue_duration_s":2.002608,"scheduling_latency_s":2.002645}1425gitlab # [ 146.376145] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.398Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f29cba2208bbb8743ccbda9","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f29cba2208bbb8743ccbda9: done: 0.024602 sec","job_status":"done","queue_duration_s":2.002608,"scheduling_latency_s":2.002645,"redis_calls":13,"redis_duration_s":0.0038069999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001321,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002486,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015485,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024602,"completed_at":"2026-08-23T07:12:32.398Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426gitlab # [ 146.379448] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.402Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf665e06ca4c7e2e6bb6a74b","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf665e06ca4c7e2e6bb6a74b: start","job_status":"start","queue_duration_s":2.030647,"scheduling_latency_s":2.03068}1427gitlab # [ 146.402815] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.425Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf665e06ca4c7e2e6bb6a74b","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf665e06ca4c7e2e6bb6a74b: done: 0.023233 sec","job_status":"done","queue_duration_s":2.030647,"scheduling_latency_s":2.03068,"redis_calls":13,"redis_duration_s":0.003686,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001206,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00248,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014787,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023233,"completed_at":"2026-08-23T07:12:32.425Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428gitlab # [ 146.413890] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.432Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"53c8924d7b74fb9ef3e5c442","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-53c8924d7b74fb9ef3e5c442: start","job_status":"start","queue_duration_s":2.060228,"scheduling_latency_s":2.060277}1429gitlab # [ 146.450439] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.451Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"53c8924d7b74fb9ef3e5c442","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-53c8924d7b74fb9ef3e5c442: done: 0.019276 sec","job_status":"done","queue_duration_s":2.060228,"scheduling_latency_s":2.060277,"redis_calls":13,"redis_duration_s":0.003785,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001122,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002663,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011718,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019276,"completed_at":"2026-08-23T07:12:32.451Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 146.456802] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.452Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33e237e0daf94e451c8a94bc","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33e237e0daf94e451c8a94bc: start","job_status":"start","queue_duration_s":2.080537,"scheduling_latency_s":2.080551}1431gitlab # [ 146.467627] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.462Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33e237e0daf94e451c8a94bc","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33e237e0daf94e451c8a94bc: done: 0.009886 sec","job_status":"done","queue_duration_s":2.080537,"scheduling_latency_s":2.080551,"redis_calls":13,"redis_duration_s":0.002338,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000772,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001566,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00591,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009886,"completed_at":"2026-08-23T07:12:32.462Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432gitlab # [ 146.521105] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.463Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a2650fcf25c25f71943a37d","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a2650fcf25c25f71943a37d: start","job_status":"start","queue_duration_s":2.091463,"scheduling_latency_s":2.091476}1433gitlab # [ 146.521680] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.473Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a2650fcf25c25f71943a37d","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a2650fcf25c25f71943a37d: done: 0.009865 sec","job_status":"done","queue_duration_s":2.091463,"scheduling_latency_s":2.091476,"redis_calls":13,"redis_duration_s":0.002454,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000764,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00169,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005878,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009865,"completed_at":"2026-08-23T07:12:32.473Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434gitlab # [ 146.540159] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.478Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04a245767f87dc8d29f03390","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04a245767f87dc8d29f03390: start","job_status":"start","queue_duration_s":2.107002,"scheduling_latency_s":2.107017}1435gitlab # [ 146.576223] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.495Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04a245767f87dc8d29f03390","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04a245767f87dc8d29f03390: done: 0.017252 sec","job_status":"done","queue_duration_s":2.107002,"scheduling_latency_s":2.107017,"redis_calls":13,"redis_duration_s":0.008813000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00219,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006623,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006733,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017252,"completed_at":"2026-08-23T07:12:32.495Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436gitlab # [ 146.581676] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.498Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d144028c9c19e696aee717a","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d144028c9c19e696aee717a: start","job_status":"start","queue_duration_s":2.127209,"scheduling_latency_s":2.127223}1437gitlab # [ 146.617436] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.514Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d144028c9c19e696aee717a","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d144028c9c19e696aee717a: done: 0.015152 sec","job_status":"done","queue_duration_s":2.127209,"scheduling_latency_s":2.127223,"redis_calls":13,"redis_duration_s":0.006586,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001762,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004824,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006611,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015152,"completed_at":"2026-08-23T07:12:32.514Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438gitlab # [ 146.622556] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.514Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37a6af28b5bdb0c2bede8159","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37a6af28b5bdb0c2bede8159: start","job_status":"start","queue_duration_s":2.143139,"scheduling_latency_s":2.143152}1439gitlab # [ 146.632562] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.524Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37a6af28b5bdb0c2bede8159","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37a6af28b5bdb0c2bede8159: done: 0.010043 sec","job_status":"done","queue_duration_s":2.143139,"scheduling_latency_s":2.143152,"redis_calls":13,"redis_duration_s":0.00209,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00067,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00142,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006306,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010043,"completed_at":"2026-08-23T07:12:32.524Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1440gitlab # [ 146.672481] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.525Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc00c0a592a951bb687300c3","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc00c0a592a951bb687300c3: start","job_status":"start","queue_duration_s":2.154132,"scheduling_latency_s":2.154145}1441gitlab # [ 146.673613] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.536Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc00c0a592a951bb687300c3","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc00c0a592a951bb687300c3: done: 0.010329 sec","job_status":"done","queue_duration_s":2.154132,"scheduling_latency_s":2.154145,"redis_calls":13,"redis_duration_s":0.002463,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000683,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00178,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006188,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010329,"completed_at":"2026-08-23T07:12:32.536Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 146.730829] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.537Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b2a64e7041a9631435dce5c","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b2a64e7041a9631435dce5c: start","job_status":"start","queue_duration_s":2.165409,"scheduling_latency_s":2.165421}1443gitlab # [ 146.731585] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.552Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b2a64e7041a9631435dce5c","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b2a64e7041a9631435dce5c: done: 0.015652 sec","job_status":"done","queue_duration_s":2.165409,"scheduling_latency_s":2.165421,"redis_calls":13,"redis_duration_s":0.0035180000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001066,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002452,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00925,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015652,"completed_at":"2026-08-23T07:12:32.552Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444gitlab # [ 146.777623] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.554Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33bec13ef4dc4974a71e2579","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33bec13ef4dc4974a71e2579: start","job_status":"start","queue_duration_s":2.182744,"scheduling_latency_s":2.182769}1445gitlab # [ 146.778402] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.566Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33bec13ef4dc4974a71e2579","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33bec13ef4dc4974a71e2579: done: 0.012457 sec","job_status":"done","queue_duration_s":2.182744,"scheduling_latency_s":2.182769,"redis_calls":13,"redis_duration_s":0.0016580000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000553,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001105,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00732,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012457,"completed_at":"2026-08-23T07:12:32.566Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446gitlab # [ 146.814024] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.567Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c6b498dc06b2549c8d90cb74","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c6b498dc06b2549c8d90cb74: start","job_status":"start","queue_duration_s":2.195931,"scheduling_latency_s":2.195944}1447gitlab # [ 146.814656] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.576Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c6b498dc06b2549c8d90cb74","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c6b498dc06b2549c8d90cb74: done: 0.009238 sec","job_status":"done","queue_duration_s":2.195931,"scheduling_latency_s":2.195944,"redis_calls":13,"redis_duration_s":0.00134,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000455,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000885,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006274,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009238,"completed_at":"2026-08-23T07:12:32.576Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 146.849615] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.577Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c7cd7915ca891a85e237281","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c7cd7915ca891a85e237281: start","job_status":"start","queue_duration_s":2.206102,"scheduling_latency_s":2.206115}1449gitlab # [ 146.850497] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.587Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c7cd7915ca891a85e237281","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c7cd7915ca891a85e237281: done: 0.009368 sec","job_status":"done","queue_duration_s":2.206102,"scheduling_latency_s":2.206115,"redis_calls":13,"redis_duration_s":0.001388,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000455,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000933,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006203,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009368,"completed_at":"2026-08-23T07:12:32.587Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1450gitlab # [ 146.892187] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.588Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8533e5031811a37ec566fc4b","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8533e5031811a37ec566fc4b: start","job_status":"start","queue_duration_s":2.216417,"scheduling_latency_s":2.21643}1451gitlab # [ 146.892854] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.597Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8533e5031811a37ec566fc4b","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8533e5031811a37ec566fc4b: done: 0.00928 sec","job_status":"done","queue_duration_s":2.216417,"scheduling_latency_s":2.21643,"redis_calls":13,"redis_duration_s":0.001342,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000449,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000893,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006456,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00928,"completed_at":"2026-08-23T07:12:32.597Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1452gitlab # [ 146.938285] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.598Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f096931239bd55f0430ae25b","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f096931239bd55f0430ae25b: start","job_status":"start","queue_duration_s":2.226615,"scheduling_latency_s":2.226628}1453gitlab # [ 146.938912] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.612Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f096931239bd55f0430ae25b","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f096931239bd55f0430ae25b: done: 0.013815 sec","job_status":"done","queue_duration_s":2.226615,"scheduling_latency_s":2.226628,"redis_calls":13,"redis_duration_s":0.00264,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001402,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001238,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006591,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013815,"completed_at":"2026-08-23T07:12:32.612Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454gitlab # [ 146.984625] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.613Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55dae5c857cc79251f4325ac","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55dae5c857cc79251f4325ac: start","job_status":"start","queue_duration_s":2.241375,"scheduling_latency_s":2.241388}1455gitlab # [ 146.985461] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.622Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55dae5c857cc79251f4325ac","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55dae5c857cc79251f4325ac: done: 0.009339 sec","job_status":"done","queue_duration_s":2.241375,"scheduling_latency_s":2.241388,"redis_calls":13,"redis_duration_s":0.001458,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000429,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001029,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006517,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009339,"completed_at":"2026-08-23T07:12:32.622Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1456gitlab # [ 146.992612] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.623Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52ca1b8af3cb5ad02dceed6e","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52ca1b8af3cb5ad02dceed6e: start","job_status":"start","queue_duration_s":2.251833,"scheduling_latency_s":2.251847}1457gitlab # [ 147.002626] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.633Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52ca1b8af3cb5ad02dceed6e","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52ca1b8af3cb5ad02dceed6e: done: 0.009661 sec","job_status":"done","queue_duration_s":2.251833,"scheduling_latency_s":2.251847,"redis_calls":13,"redis_duration_s":0.001362,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00046,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000902,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006834,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009661,"completed_at":"2026-08-23T07:12:32.633Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1458gitlab # [ 147.034297] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.634Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6367600b13366238d10cd19","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6367600b13366238d10cd19: start","job_status":"start","queue_duration_s":2.26243,"scheduling_latency_s":2.262444}1459gitlab # [ 147.044595] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:12:32.650Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6367600b13366238d10cd19","created_at":"2026-08-23T07:12:30.281Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-b3599a1c968445b9","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"774de49d7499dfd7e9e87799e36fe7bc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:12:30.371Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6367600b13366238d10cd19: done: 0.015963 sec","job_status":"done","queue_duration_s":2.26243,"scheduling_latency_s":2.262444,"redis_calls":13,"redis_duration_s":0.0074800000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001309,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006171,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006786,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015963,"completed_at":"2026-08-23T07:12:32.649Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460gitlab # [ 159.697277] setup-gitlab-start[2219]: W, [2026-08-23T07:12:45.719810 #2219] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1461gitlab # [ 176.897179] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:02.918Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"afec3bde2ff9ab486bcb7e6c","created_at":"2026-08-23T07:13:02.864Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3bdbde654f7facabdeccca9e39374f93","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:02.915Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-afec3bde2ff9ab486bcb7e6c: start","job_status":"start","queue_duration_s":0.002787,"scheduling_latency_s":0.002836}1462gitlab # [ 177.068964] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:03.091Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"afec3bde2ff9ab486bcb7e6c","created_at":"2026-08-23T07:13:02.864Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3bdbde654f7facabdeccca9e39374f93","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:02.915Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-afec3bde2ff9ab486bcb7e6c: done: 0.17307 sec","job_status":"done","queue_duration_s":0.002787,"scheduling_latency_s":0.002836,"redis_calls":14,"redis_duration_s":0.032861,"redis_read_bytes":16,"redis_write_bytes":4030,"redis_queues_calls":2,"redis_queues_duration_s":0.000397,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.006958,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.025506,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.049,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.049,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035691,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.17307,"completed_at":"2026-08-23T07:13:03.091Z","load_balancing_strategy":"primary","db_duration_s":0.055477,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1463gitlab # [ 177.113148] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:03.100Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"8b06a19c3617aa6b57ffaa69","created_at":"2026-08-23T07:13:02.960Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c84c3af61e2732e4979498e5984469ae","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:02.964Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-8b06a19c3617aa6b57ffaa69: start","job_status":"start","queue_duration_s":0.136408,"scheduling_latency_s":0.13646}1464gitlab # [ 177.124683] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:03.132Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"8b06a19c3617aa6b57ffaa69","created_at":"2026-08-23T07:13:02.960Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c84c3af61e2732e4979498e5984469ae","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:02.964Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-8b06a19c3617aa6b57ffaa69: done: 0.032551 sec","job_status":"done","queue_duration_s":0.136408,"scheduling_latency_s":0.13646,"redis_calls":7,"redis_duration_s":0.00813,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002193,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005937,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013139,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032551,"completed_at":"2026-08-23T07:13:03.132Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1465gitlab # [ 177.157740] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:03.135Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"e635c9922d624ea69c0801be","created_at":"2026-08-23T07:13:03.000Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e2a0846fb3bf592b8a25255f859c5bc8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-23T07:13:03.012Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-e635c9922d624ea69c0801be: start","job_status":"start","queue_duration_s":0.123508,"scheduling_latency_s":0.123541}1466gitlab # [ 177.168552] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:03.157Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1467gitlab # [ 177.171343] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:03.181Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"e635c9922d624ea69c0801be","created_at":"2026-08-23T07:13:03.000Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e2a0846fb3bf592b8a25255f859c5bc8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-23T07:13:03.012Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-e635c9922d624ea69c0801be: done: 0.045555 sec","job_status":"done","queue_duration_s":0.123508,"scheduling_latency_s":0.123541,"redis_calls":7,"redis_duration_s":0.0028,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001751,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001049,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012115,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.045555,"completed_at":"2026-08-23T07:13:03.181Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1468gitlab # [ 177.202184] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:03.184Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"295acff74cfc562b867355b8","created_at":"2026-08-23T07:13:03.019Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"67eb3d82814616a0bf0dde17a7348061","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-23T07:13:03.021Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-295acff74cfc562b867355b8: start","job_status":"start","queue_duration_s":0.16209,"scheduling_latency_s":0.162141}1469gitlab # [ 177.213934] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:03.223Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1470gitlab # [ 177.214868] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:03.235Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"295acff74cfc562b867355b8","created_at":"2026-08-23T07:13:03.019Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"67eb3d82814616a0bf0dde17a7348061","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-23T07:13:03.021Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-295acff74cfc562b867355b8: done: 0.051929 sec","job_status":"done","queue_duration_s":0.16209,"scheduling_latency_s":0.162141,"redis_calls":7,"redis_duration_s":0.005188,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003831,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001357,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012948,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.051929,"completed_at":"2026-08-23T07:13:03.235Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1471gitlab # [ 177.216379] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:03.237Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"fb9379e2e039a69c52d0dab4","created_at":"2026-08-23T07:13:03.028Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"653deea2b9d90fc5ec3bbc611d5d11a7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.030Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-fb9379e2e039a69c52d0dab4: start","job_status":"start","queue_duration_s":0.207132,"scheduling_latency_s":0.207155}1472gitlab # [ 177.349189] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:03.371Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"fb9379e2e039a69c52d0dab4","created_at":"2026-08-23T07:13:03.028Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"653deea2b9d90fc5ec3bbc611d5d11a7","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.030Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-fb9379e2e039a69c52d0dab4: done: 0.13412 sec","job_status":"done","queue_duration_s":0.207132,"scheduling_latency_s":0.207155,"redis_calls":9,"redis_duration_s":0.012591,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004411,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00818,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.035,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.035,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024176,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001275581,"exclusive_lock_hold_duration_s":0.030076727,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.13412,"completed_at":"2026-08-23T07:13:03.371Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.037311,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1473gitlab # [ 177.368346] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:03.374Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"8534012498007fc37d74967b","created_at":"2026-08-23T07:13:03.036Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3d77bd38fa780975c086410694686360","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.037Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-8534012498007fc37d74967b: start","job_status":"start","queue_duration_s":0.336714,"scheduling_latency_s":0.336754}1474gitlab # [ 177.571886] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:03.594Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"8534012498007fc37d74967b","created_at":"2026-08-23T07:13:03.036Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3d77bd38fa780975c086410694686360","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.037Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-8534012498007fc37d74967b: done: 0.220332 sec","job_status":"done","queue_duration_s":0.336714,"scheduling_latency_s":0.336754,"redis_calls":562,"redis_duration_s":0.064458,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001514,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.062944,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.179845,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.220332,"completed_at":"2026-08-23T07:13:03.594Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1475gitlab # [ 177.620698] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:03.643Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"3bfb8c2da13a6a4ce66c1e60","created_at":"2026-08-23T07:13:03.057Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5199a736fe7e97d12a83c2393f7d716a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.059Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-3bfb8c2da13a6a4ce66c1e60: start","job_status":"start","queue_duration_s":0.584633,"scheduling_latency_s":0.584659}1476gitlab # [ 177.640984] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:03.663Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"3bfb8c2da13a6a4ce66c1e60","created_at":"2026-08-23T07:13:03.057Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5199a736fe7e97d12a83c2393f7d716a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.059Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-3bfb8c2da13a6a4ce66c1e60: done: 0.020319 sec","job_status":"done","queue_duration_s":0.584633,"scheduling_latency_s":0.584659,"redis_calls":7,"redis_duration_s":0.000946,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00068,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000266,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005756,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020319,"completed_at":"2026-08-23T07:13:03.663Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1477gitlab # [ 177.674170] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:03.697Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"a495a38500929c663215bb88","created_at":"2026-08-23T07:13:03.071Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"44f2b75de496b96c3e31fc4b8d9f97dc","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.074Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-a495a38500929c663215bb88: start","job_status":"start","queue_duration_s":0.622361,"scheduling_latency_s":0.622382}1478gitlab # [ 177.702881] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:03.725Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"a495a38500929c663215bb88","created_at":"2026-08-23T07:13:03.071Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"44f2b75de496b96c3e31fc4b8d9f97dc","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.074Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-a495a38500929c663215bb88: done: 0.028407 sec","job_status":"done","queue_duration_s":0.622361,"scheduling_latency_s":0.622382,"redis_calls":7,"redis_duration_s":0.00217,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001559,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000611,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011571,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.028407,"completed_at":"2026-08-23T07:13:03.725Z","load_balancing_strategy":"primary","db_duration_s":0.01108,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1479gitlab # [ 177.737326] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:03.760Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"21864e388f4f3e785fee024e","created_at":"2026-08-23T07:13:03.061Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-195854596b7b4964","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3bdbde654f7facabdeccca9e39374f93","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.078Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-21864e388f4f3e785fee024e: start","job_status":"start","queue_duration_s":0.681379,"scheduling_latency_s":0.681417}1480gitlab # [ 177.753079] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:03.776Z","message":"No existing merge request to be cleaned up."}1481gitlab # [ 177.765599] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:03.788Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"21864e388f4f3e785fee024e","created_at":"2026-08-23T07:13:03.061Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-195854596b7b4964","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3bdbde654f7facabdeccca9e39374f93","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.078Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-21864e388f4f3e785fee024e: done: 0.028164 sec","job_status":"done","queue_duration_s":0.681379,"scheduling_latency_s":0.681417,"redis_calls":10,"redis_duration_s":0.004321,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00115,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003171,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017096,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028164,"completed_at":"2026-08-23T07:13:03.788Z","load_balancing_strategy":"primary","db_duration_s":0.002902,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1482gitlab # [ 177.798730] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:03.821Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9108fdc1c2ee8f0728af2caa","created_at":"2026-08-23T07:13:03.061Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-195854596b7b4964","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3bdbde654f7facabdeccca9e39374f93","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.078Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9108fdc1c2ee8f0728af2caa: start","job_status":"start","queue_duration_s":0.742815,"scheduling_latency_s":0.742852}1483gitlab # [ 177.813884] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:03.837Z","message":"No existing merge request to be cleaned up."}1484gitlab # [ 177.825978] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:03.848Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9108fdc1c2ee8f0728af2caa","created_at":"2026-08-23T07:13:03.061Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-195854596b7b4964","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3bdbde654f7facabdeccca9e39374f93","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.078Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9108fdc1c2ee8f0728af2caa: done: 0.027077 sec","job_status":"done","queue_duration_s":0.742815,"scheduling_latency_s":0.742852,"redis_calls":10,"redis_duration_s":0.00425,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001135,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003115,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016524,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027077,"completed_at":"2026-08-23T07:13:03.848Z","load_balancing_strategy":"primary","db_duration_s":0.002599,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1485gitlab # [ 177.857911] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:03.880Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e6875dc4cb4450ed6932b8fe","created_at":"2026-08-23T07:13:03.061Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-195854596b7b4964","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3bdbde654f7facabdeccca9e39374f93","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.078Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e6875dc4cb4450ed6932b8fe: start","job_status":"start","queue_duration_s":0.801984,"scheduling_latency_s":0.802021}1486gitlab # [ 177.883235] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:03.906Z","message":"No existing merge request to be cleaned up."}1487gitlab # [ 177.895425] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:03.918Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e6875dc4cb4450ed6932b8fe","created_at":"2026-08-23T07:13:03.061Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-195854596b7b4964","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3bdbde654f7facabdeccca9e39374f93","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.078Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e6875dc4cb4450ed6932b8fe: done: 0.037447 sec","job_status":"done","queue_duration_s":0.801984,"scheduling_latency_s":0.802021,"redis_calls":10,"redis_duration_s":0.003187,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00127,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001917,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019192,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037447,"completed_at":"2026-08-23T07:13:03.918Z","load_balancing_strategy":"primary","db_duration_s":0.002172,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1488gitlab # [ 177.915201] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:03.920Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"132324ebf5095fc8fba67106","created_at":"2026-08-23T07:13:03.061Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-195854596b7b4964","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3bdbde654f7facabdeccca9e39374f93","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.078Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-132324ebf5095fc8fba67106: start","job_status":"start","queue_duration_s":0.841936,"scheduling_latency_s":0.841967}1489gitlab # [ 177.915892] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:03.936Z","message":"No existing merge request to be cleaned up."}1490gitlab # [ 177.948961] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:03.971Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"132324ebf5095fc8fba67106","created_at":"2026-08-23T07:13:03.061Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-195854596b7b4964","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3bdbde654f7facabdeccca9e39374f93","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.078Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-132324ebf5095fc8fba67106: done: 0.051015 sec","job_status":"done","queue_duration_s":0.841936,"scheduling_latency_s":0.841967,"redis_calls":10,"redis_duration_s":0.026973999999999998,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00139,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.025584,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014532,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.051015,"completed_at":"2026-08-23T07:13:03.971Z","load_balancing_strategy":"primary","db_duration_s":0.002636,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1491gitlab # [ 177.979451] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:03.973Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"0f6f8f4918a27827c8edb4a4","created_at":"2026-08-23T07:13:03.083Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"57e3042ffd8dea6030a3515045093565","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.085Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-0f6f8f4918a27827c8edb4a4: start","job_status":"start","queue_duration_s":0.888468,"scheduling_latency_s":0.888502}1492gitlab # [ 177.991086] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:03.987Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1493gitlab # [ 177.993892] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:03.996Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"0f6f8f4918a27827c8edb4a4","created_at":"2026-08-23T07:13:03.083Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"57e3042ffd8dea6030a3515045093565","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.085Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-0f6f8f4918a27827c8edb4a4: done: 0.022515 sec","job_status":"done","queue_duration_s":0.888468,"scheduling_latency_s":0.888502,"redis_calls":7,"redis_duration_s":0.005237,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001668,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003569,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010464,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022515,"completed_at":"2026-08-23T07:13:03.996Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1494gitlab # [ 178.026042] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:03.997Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"38edc80672bbc18e533df06a","created_at":"2026-08-23T07:13:03.097Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f14007d73e1ab5f00717850d14343f72","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.099Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-38edc80672bbc18e533df06a: start","job_status":"start","queue_duration_s":0.897965,"scheduling_latency_s":0.897979}1495gitlab # [ 178.026591] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:04.002Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1496gitlab # [ 178.027053] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:04.005Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"38edc80672bbc18e533df06a","created_at":"2026-08-23T07:13:03.097Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f14007d73e1ab5f00717850d14343f72","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.099Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-38edc80672bbc18e533df06a: done: 0.008176 sec","job_status":"done","queue_duration_s":0.897965,"scheduling_latency_s":0.897979,"redis_calls":7,"redis_duration_s":0.001539,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001223,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000316,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00462,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008176,"completed_at":"2026-08-23T07:13:04.005Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1497gitlab # [ 178.036805] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:04.006Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"d8e22bc9804731b1f7d32546","created_at":"2026-08-23T07:13:03.116Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f30b7212f788c8b692f250429d20c339","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.127Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-d8e22bc9804731b1f7d32546: start","job_status":"start","queue_duration_s":0.879134,"scheduling_latency_s":0.879147}1498gitlab # [ 178.048390] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:04.046Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"d8e22bc9804731b1f7d32546","created_at":"2026-08-23T07:13:03.116Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f30b7212f788c8b692f250429d20c339","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.127Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-d8e22bc9804731b1f7d32546: done: 0.040295 sec","job_status":"done","queue_duration_s":0.879134,"scheduling_latency_s":0.879147,"redis_calls":9,"redis_duration_s":0.001288,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00065,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000638,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013296,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000319873,"exclusive_lock_hold_duration_s":0.031168487,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.040295,"completed_at":"2026-08-23T07:13:04.046Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027316,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1499gitlab # [ 178.091741] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:04.047Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"e69a3b384273a335aaf60dc5","created_at":"2026-08-23T07:13:03.142Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8526950f4394300bd26556d7541e367c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.145Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-e69a3b384273a335aaf60dc5: start","job_status":"start","queue_duration_s":0.90276,"scheduling_latency_s":0.902774}1500gitlab # [ 178.272335] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:04.295Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"e69a3b384273a335aaf60dc5","created_at":"2026-08-23T07:13:03.142Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8526950f4394300bd26556d7541e367c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.145Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-e69a3b384273a335aaf60dc5: done: 0.247304 sec","job_status":"done","queue_duration_s":0.90276,"scheduling_latency_s":0.902774,"redis_calls":9,"redis_duration_s":0.098646,"redis_read_bytes":7,"redis_write_bytes":987,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000973,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.097673,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.031,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.104317,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000405638,"exclusive_lock_hold_duration_s":0.135425034,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.247304,"completed_at":"2026-08-23T07:13:04.295Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.047845,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1501gitlab # [ 178.343689] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:04.296Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"cbe08374191c09b55d9c6423","created_at":"2026-08-23T07:13:03.176Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"794e2a01d233548fe821aeb04782bd54","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.179Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-cbe08374191c09b55d9c6423: start","job_status":"start","queue_duration_s":1.117181,"scheduling_latency_s":1.117195}1502gitlab # [ 178.355367] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:04.301Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1503gitlab # [ 178.358512] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:04.304Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"cbe08374191c09b55d9c6423","created_at":"2026-08-23T07:13:03.176Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"794e2a01d233548fe821aeb04782bd54","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.179Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-cbe08374191c09b55d9c6423: done: 0.007978 sec","job_status":"done","queue_duration_s":1.117181,"scheduling_latency_s":1.117195,"redis_calls":7,"redis_duration_s":0.000985,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000646,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000339,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004691,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.007978,"completed_at":"2026-08-23T07:13:04.304Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1504gitlab # [ 178.390570] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:04.305Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"2254b119738526a3f7c41a09","created_at":"2026-08-23T07:13:03.216Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"81efd2956175bbf085c0bf260067438d","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.220Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-2254b119738526a3f7c41a09: start","job_status":"start","queue_duration_s":1.085109,"scheduling_latency_s":1.085122}1505gitlab # [ 178.401732] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:04.314Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"2254b119738526a3f7c41a09","created_at":"2026-08-23T07:13:03.216Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"81efd2956175bbf085c0bf260067438d","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.220Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-2254b119738526a3f7c41a09: done: 0.009481 sec","job_status":"done","queue_duration_s":1.085109,"scheduling_latency_s":1.085122,"redis_calls":7,"redis_duration_s":0.000963,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000719,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000244,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005292,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009481,"completed_at":"2026-08-23T07:13:04.314Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001335,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1506gitlab # [ 178.433355] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:04.315Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"e593d552a9c9ac35984429f4","created_at":"2026-08-23T07:13:03.230Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1fc7e53fbcddd3cc97b8ca9e26208b7c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.234Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-e593d552a9c9ac35984429f4: start","job_status":"start","queue_duration_s":1.081256,"scheduling_latency_s":1.081271}1507gitlab # [ 178.446631] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:04.320Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1508gitlab # [ 178.449756] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:04.322Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"e593d552a9c9ac35984429f4","created_at":"2026-08-23T07:13:03.230Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1fc7e53fbcddd3cc97b8ca9e26208b7c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.234Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-e593d552a9c9ac35984429f4: done: 0.007397 sec","job_status":"done","queue_duration_s":1.081256,"scheduling_latency_s":1.081271,"redis_calls":7,"redis_duration_s":0.000937,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000693,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000244,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004515,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.007397,"completed_at":"2026-08-23T07:13:04.322Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1509gitlab # [ 178.482621] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:04.323Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"291cbf6432eac77656752d24","created_at":"2026-08-23T07:13:03.295Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"88470d6ae936afced3e091b7e97c88e1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-23T07:13:03.299Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-291cbf6432eac77656752d24: start","job_status":"start","queue_duration_s":1.024383,"scheduling_latency_s":1.024396}1510gitlab # [ 178.483246] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:04.336Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"291cbf6432eac77656752d24","created_at":"2026-08-23T07:13:03.295Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"88470d6ae936afced3e091b7e97c88e1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-23T07:13:03.299Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-291cbf6432eac77656752d24: done: 0.013019 sec","job_status":"done","queue_duration_s":1.024383,"scheduling_latency_s":1.024396,"redis_calls":7,"redis_duration_s":0.000973,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000728,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000245,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008245,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013019,"completed_at":"2026-08-23T07:13:04.336Z","load_balancing_strategy":"primary","db_duration_s":0.001935,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1511gitlab # [ 178.488775] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:04.337Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"81b3449ef8e7b3ba17376159","created_at":"2026-08-23T07:13:03.305Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"91eb61a90d895c4817a6119b830cb6e8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.306Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-81b3449ef8e7b3ba17376159: start","job_status":"start","queue_duration_s":1.031224,"scheduling_latency_s":1.031238}1512gitlab # [ 178.499837] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:04.349Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"81b3449ef8e7b3ba17376159","created_at":"2026-08-23T07:13:03.305Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"91eb61a90d895c4817a6119b830cb6e8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.306Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-81b3449ef8e7b3ba17376159: done: 0.011422 sec","job_status":"done","queue_duration_s":1.031224,"scheduling_latency_s":1.031238,"redis_calls":9,"redis_duration_s":0.001294,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000719,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000575,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005997,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000300597,"exclusive_lock_hold_duration_s":0.003570007,"duration_s":0.011422,"completed_at":"2026-08-23T07:13:04.349Z","load_balancing_strategy":"primary","db_duration_s":0.002392,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1513gitlab # [ 178.536611] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:04.349Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"90e86d3d370776df33a3c354","created_at":"2026-08-23T07:13:03.309Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0b2eefd8e0f6e796e936b9a64b7c936c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.314Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-90e86d3d370776df33a3c354: start","job_status":"start","queue_duration_s":1.035659,"scheduling_latency_s":1.035671}1514gitlab # [ 178.573144] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:04.370Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"90e86d3d370776df33a3c354","created_at":"2026-08-23T07:13:03.309Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0b2eefd8e0f6e796e936b9a64b7c936c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.314Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-90e86d3d370776df33a3c354: done: 0.021014 sec","job_status":"done","queue_duration_s":1.035659,"scheduling_latency_s":1.035671,"redis_calls":12,"redis_duration_s":0.001694,"redis_read_bytes":11,"redis_write_bytes":1281,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000252,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000732,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":518,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00071,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":476,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010139,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000301994,"exclusive_lock_hold_duration_s":0.009031593999999999,"duration_s":0.021014,"completed_at":"2026-08-23T07:13:04.370Z","load_balancing_strategy":"primary","db_duration_s":0.006464,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1515gitlab # [ 178.574689] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:04.371Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"9082d64e879d489ae41fd1bb","created_at":"2026-08-23T07:13:03.318Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9133c38207aefc0c4ce66215c98b6f2d","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.321Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-9082d64e879d489ae41fd1bb: start","job_status":"start","queue_duration_s":1.050812,"scheduling_latency_s":1.050826}1516gitlab # [ 178.586561] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:04.381Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"9082d64e879d489ae41fd1bb","created_at":"2026-08-23T07:13:03.318Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9133c38207aefc0c4ce66215c98b6f2d","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.321Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-9082d64e879d489ae41fd1bb: done: 0.009983 sec","job_status":"done","queue_duration_s":1.050812,"scheduling_latency_s":1.050826,"redis_calls":9,"redis_duration_s":0.00129,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000696,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000594,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005738,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000314007,"exclusive_lock_hold_duration_s":0.002018971,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.009983,"completed_at":"2026-08-23T07:13:04.381Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001142,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1517gitlab # [ 178.633647] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:04.382Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"4d1c0ee2c7e5894373580c8a","created_at":"2026-08-23T07:13:03.327Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.330Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-4d1c0ee2c7e5894373580c8a: start","job_status":"start","queue_duration_s":1.052245,"scheduling_latency_s":1.052257}1518gitlab # [ 178.634451] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:04.470Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"4d1c0ee2c7e5894373580c8a","created_at":"2026-08-23T07:13:03.327Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.330Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-4d1c0ee2c7e5894373580c8a: done: 0.087534 sec","job_status":"done","queue_duration_s":1.052245,"scheduling_latency_s":1.052257,"redis_calls":60,"redis_duration_s":0.008454,"redis_read_bytes":108,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.000575,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.0075,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000379,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.078375,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.087534,"completed_at":"2026-08-23T07:13:04.470Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1519gitlab # [ 178.663694] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:04.471Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"25e2ab0ad33097c50356b45b","created_at":"2026-08-23T07:13:03.344Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"73f5ae6c89f7581e6d7b119fb77f939e","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.349Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-25e2ab0ad33097c50356b45b: start","job_status":"start","queue_duration_s":1.121283,"scheduling_latency_s":1.1213}1520gitlab # [ 178.675092] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:04.485Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"25e2ab0ad33097c50356b45b","created_at":"2026-08-23T07:13:03.344Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"73f5ae6c89f7581e6d7b119fb77f939e","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.349Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-25e2ab0ad33097c50356b45b: done: 0.014026 sec","job_status":"done","queue_duration_s":1.121283,"scheduling_latency_s":1.1213,"redis_calls":7,"redis_duration_s":0.000944,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000686,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000258,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007306,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014026,"completed_at":"2026-08-23T07:13:04.485Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003816,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1521gitlab # [ 178.736250] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:04.486Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"9f386358091a7b9bf9244269","created_at":"2026-08-23T07:13:03.357Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"25ad9ab57f9cdff5a680dfe379f3b928","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.364Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-9f386358091a7b9bf9244269: start","job_status":"start","queue_duration_s":1.121082,"scheduling_latency_s":1.121097}1522gitlab # [ 178.737058] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:04.499Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"9f386358091a7b9bf9244269","created_at":"2026-08-23T07:13:03.357Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-079c99ee252e4939","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"25ad9ab57f9cdff5a680dfe379f3b928","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:03.364Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-9f386358091a7b9bf9244269: done: 0.013476 sec","job_status":"done","queue_duration_s":1.121082,"scheduling_latency_s":1.121097,"redis_calls":10,"redis_duration_s":0.001317,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000773,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000544,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007172,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.003623086,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.013476,"completed_at":"2026-08-23T07:13:04.499Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002368,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1523gitlab # [ 178.784147] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:04.500Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66d698cad6a09500754aff3c","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66d698cad6a09500754aff3c: start","job_status":"start","queue_duration_s":0.035103,"scheduling_latency_s":0.035115}1524gitlab # [ 178.805333] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:04.828Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66d698cad6a09500754aff3c","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66d698cad6a09500754aff3c: done: 0.328008 sec","job_status":"done","queue_duration_s":0.035103,"scheduling_latency_s":0.035115,"redis_calls":13,"redis_duration_s":0.318256,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.317714,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008257,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.328008,"completed_at":"2026-08-23T07:13:04.828Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1525gitlab # [ 178.837837] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:04.830Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aeb5bbdfc3be2c8b7e0b7d90","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aeb5bbdfc3be2c8b7e0b7d90: start","job_status":"start","queue_duration_s":0.36477,"scheduling_latency_s":0.36479}1526gitlab # [ 178.838762] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:04.845Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aeb5bbdfc3be2c8b7e0b7d90","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aeb5bbdfc3be2c8b7e0b7d90: done: 0.015294 sec","job_status":"done","queue_duration_s":0.36477,"scheduling_latency_s":0.36479,"redis_calls":13,"redis_duration_s":0.0029960000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000894,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002102,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009858,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015294,"completed_at":"2026-08-23T07:13:04.845Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1527gitlab # [ 178.876157] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:04.846Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5577f667c67dadbc39c373a5","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5577f667c67dadbc39c373a5: start","job_status":"start","queue_duration_s":0.381081,"scheduling_latency_s":0.381095}1528gitlab # [ 178.876933] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:04.856Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5577f667c67dadbc39c373a5","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5577f667c67dadbc39c373a5: done: 0.010228 sec","job_status":"done","queue_duration_s":0.381081,"scheduling_latency_s":0.381095,"redis_calls":13,"redis_duration_s":0.002529,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000774,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001755,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005771,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010228,"completed_at":"2026-08-23T07:13:04.856Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1529gitlab # [ 178.912056] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:04.858Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a4348a6cf2f2cc42288668c4","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a4348a6cf2f2cc42288668c4: start","job_status":"start","queue_duration_s":0.392756,"scheduling_latency_s":0.39277}1530gitlab # [ 178.951434] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:04.973Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a4348a6cf2f2cc42288668c4","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a4348a6cf2f2cc42288668c4: done: 0.115214 sec","job_status":"done","queue_duration_s":0.392756,"scheduling_latency_s":0.39277,"redis_calls":13,"redis_duration_s":0.097844,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.09307,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004774,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015165,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.115214,"completed_at":"2026-08-23T07:13:04.973Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1531gitlab # [ 178.984581] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.007Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b8d6b4059d30b6be7ae3501","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b8d6b4059d30b6be7ae3501: start","job_status":"start","queue_duration_s":0.541994,"scheduling_latency_s":0.542042}1532gitlab # [ 179.010310] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.033Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b8d6b4059d30b6be7ae3501","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b8d6b4059d30b6be7ae3501: done: 0.025857 sec","job_status":"done","queue_duration_s":0.541994,"scheduling_latency_s":0.542042,"redis_calls":13,"redis_duration_s":0.003894,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00141,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002484,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016197,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025857,"completed_at":"2026-08-23T07:13:05.032Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1533gitlab # [ 179.021767] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.044Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41561a193c5951ee76637e17","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41561a193c5951ee76637e17: start","job_status":"start","queue_duration_s":0.579294,"scheduling_latency_s":0.579343}1534gitlab # [ 179.046442] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.068Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41561a193c5951ee76637e17","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41561a193c5951ee76637e17: done: 0.024159 sec","job_status":"done","queue_duration_s":0.579294,"scheduling_latency_s":0.579343,"redis_calls":13,"redis_duration_s":0.003867,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0015,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002367,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013772,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024159,"completed_at":"2026-08-23T07:13:05.068Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1535gitlab # [ 179.048116] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.071Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a64d88985300a6dc5096a624","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a64d88985300a6dc5096a624: start","job_status":"start","queue_duration_s":0.605902,"scheduling_latency_s":0.60593}1536gitlab # [ 179.059592] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.082Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a64d88985300a6dc5096a624","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a64d88985300a6dc5096a624: done: 0.011563 sec","job_status":"done","queue_duration_s":0.605902,"scheduling_latency_s":0.60593,"redis_calls":13,"redis_duration_s":0.001568,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001035,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006462,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011563,"completed_at":"2026-08-23T07:13:05.082Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1537gitlab # [ 179.120859] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.083Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72c42516a0cd7b202afff951","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72c42516a0cd7b202afff951: start","job_status":"start","queue_duration_s":0.618269,"scheduling_latency_s":0.618282}1538gitlab # [ 179.121513] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.092Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72c42516a0cd7b202afff951","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72c42516a0cd7b202afff951: done: 0.009342 sec","job_status":"done","queue_duration_s":0.618269,"scheduling_latency_s":0.618282,"redis_calls":13,"redis_duration_s":0.001939,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000915,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001024,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006128,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009342,"completed_at":"2026-08-23T07:13:05.092Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1539gitlab # [ 179.159080] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.093Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8b1d16dc2da0ab7a110fde9","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8b1d16dc2da0ab7a110fde9: start","job_status":"start","queue_duration_s":0.628487,"scheduling_latency_s":0.628499}1540gitlab # [ 179.159705] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.102Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8b1d16dc2da0ab7a110fde9","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8b1d16dc2da0ab7a110fde9: done: 0.009221 sec","job_status":"done","queue_duration_s":0.628487,"scheduling_latency_s":0.628499,"redis_calls":13,"redis_duration_s":0.001498,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000492,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001006,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005552,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009221,"completed_at":"2026-08-23T07:13:05.102Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1541gitlab # [ 179.195086] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.104Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a7905fb0cc7d725392dd007a","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a7905fb0cc7d725392dd007a: start","job_status":"start","queue_duration_s":0.639033,"scheduling_latency_s":0.639046}1542gitlab # [ 179.195706] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.113Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a7905fb0cc7d725392dd007a","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a7905fb0cc7d725392dd007a: done: 0.009469 sec","job_status":"done","queue_duration_s":0.639033,"scheduling_latency_s":0.639046,"redis_calls":13,"redis_duration_s":0.002038,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001012,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001026,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006169,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009469,"completed_at":"2026-08-23T07:13:05.113Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1543gitlab # [ 179.237275] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.114Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8340da27282eef2eecc9b41","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8340da27282eef2eecc9b41: start","job_status":"start","queue_duration_s":0.649329,"scheduling_latency_s":0.649341}1544gitlab # [ 179.237987] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.124Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8340da27282eef2eecc9b41","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8340da27282eef2eecc9b41: done: 0.009475 sec","job_status":"done","queue_duration_s":0.649329,"scheduling_latency_s":0.649341,"redis_calls":13,"redis_duration_s":0.00206,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001526,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006223,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009475,"completed_at":"2026-08-23T07:13:05.124Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1545gitlab # [ 179.274617] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.124Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2ac5b7e0f92679eb655450f8","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2ac5b7e0f92679eb655450f8: start","job_status":"start","queue_duration_s":0.659623,"scheduling_latency_s":0.659636}1546gitlab # [ 179.275258] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.134Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2ac5b7e0f92679eb655450f8","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2ac5b7e0f92679eb655450f8: done: 0.009438 sec","job_status":"done","queue_duration_s":0.659623,"scheduling_latency_s":0.659636,"redis_calls":13,"redis_duration_s":0.002018,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001493,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006189,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009438,"completed_at":"2026-08-23T07:13:05.134Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1547gitlab # [ 179.313140] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.135Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef24f509fec21e1cea4f9c4c","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef24f509fec21e1cea4f9c4c: start","job_status":"start","queue_duration_s":0.669902,"scheduling_latency_s":0.669915}1548gitlab # [ 179.313723] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.144Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef24f509fec21e1cea4f9c4c","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef24f509fec21e1cea4f9c4c: done: 0.009391 sec","job_status":"done","queue_duration_s":0.669902,"scheduling_latency_s":0.669915,"redis_calls":13,"redis_duration_s":0.001595,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001092,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005642,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009391,"completed_at":"2026-08-23T07:13:05.144Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1549gitlab # [ 179.353311] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.145Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98ce02e6b46d83cf818c617c","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98ce02e6b46d83cf818c617c: start","job_status":"start","queue_duration_s":0.680607,"scheduling_latency_s":0.68062}1550gitlab # [ 179.353947] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.155Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98ce02e6b46d83cf818c617c","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98ce02e6b46d83cf818c617c: done: 0.009742 sec","job_status":"done","queue_duration_s":0.680607,"scheduling_latency_s":0.68062,"redis_calls":13,"redis_duration_s":0.0016489999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001138,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006196,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009742,"completed_at":"2026-08-23T07:13:05.155Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1551gitlab # [ 179.392473] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.156Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b03cca5ef3659f05e72e206d","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b03cca5ef3659f05e72e206d: start","job_status":"start","queue_duration_s":0.691146,"scheduling_latency_s":0.69116}1552gitlab # [ 179.393171] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.165Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b03cca5ef3659f05e72e206d","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b03cca5ef3659f05e72e206d: done: 0.009403 sec","job_status":"done","queue_duration_s":0.691146,"scheduling_latency_s":0.69116,"redis_calls":13,"redis_duration_s":0.001568,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00105,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006123,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009403,"completed_at":"2026-08-23T07:13:05.165Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1553gitlab # [ 179.428189] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.166Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e7d9fef7c4a0e65f9da2719","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e7d9fef7c4a0e65f9da2719: start","job_status":"start","queue_duration_s":0.701376,"scheduling_latency_s":0.701389}1554gitlab # [ 179.428810] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.178Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e7d9fef7c4a0e65f9da2719","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e7d9fef7c4a0e65f9da2719: done: 0.01223 sec","job_status":"done","queue_duration_s":0.701376,"scheduling_latency_s":0.701389,"redis_calls":13,"redis_duration_s":0.0017530000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000599,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001154,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00873,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01223,"completed_at":"2026-08-23T07:13:05.178Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1555gitlab # [ 179.469174] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.179Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41380ce9aec9c6decafb2828","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41380ce9aec9c6decafb2828: start","job_status":"start","queue_duration_s":0.714659,"scheduling_latency_s":0.714677}1556gitlab # [ 179.469785] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.193Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41380ce9aec9c6decafb2828","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41380ce9aec9c6decafb2828: done: 0.013553 sec","job_status":"done","queue_duration_s":0.714659,"scheduling_latency_s":0.714677,"redis_calls":13,"redis_duration_s":0.0017230000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000576,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001147,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006842,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013553,"completed_at":"2026-08-23T07:13:05.193Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1557gitlab # [ 179.501420] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.194Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83c927912e1a654142b04b04","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83c927912e1a654142b04b04: start","job_status":"start","queue_duration_s":0.729596,"scheduling_latency_s":0.72961}1558gitlab # [ 179.511567] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.204Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83c927912e1a654142b04b04","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83c927912e1a654142b04b04: done: 0.009307 sec","job_status":"done","queue_duration_s":0.729596,"scheduling_latency_s":0.72961,"redis_calls":13,"redis_duration_s":0.001452,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000466,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000986,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006296,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009307,"completed_at":"2026-08-23T07:13:05.204Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1559gitlab # [ 179.550294] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.204Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8604a4d94eef7f5620aa8be8","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8604a4d94eef7f5620aa8be8: start","job_status":"start","queue_duration_s":0.739695,"scheduling_latency_s":0.739707}1560gitlab # [ 179.552211] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.213Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8604a4d94eef7f5620aa8be8","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8604a4d94eef7f5620aa8be8: done: 0.009051 sec","job_status":"done","queue_duration_s":0.739695,"scheduling_latency_s":0.739707,"redis_calls":13,"redis_duration_s":0.0014390000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000465,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000974,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006192,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009051,"completed_at":"2026-08-23T07:13:05.213Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1561gitlab # [ 179.588962] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.214Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db1f84b2e660fc4fb1e3a165","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db1f84b2e660fc4fb1e3a165: start","job_status":"start","queue_duration_s":0.749552,"scheduling_latency_s":0.749565}1562gitlab # [ 179.626604] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.224Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db1f84b2e660fc4fb1e3a165","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db1f84b2e660fc4fb1e3a165: done: 0.009276 sec","job_status":"done","queue_duration_s":0.749552,"scheduling_latency_s":0.749565,"redis_calls":13,"redis_duration_s":0.001663,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000558,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001105,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006069,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009276,"completed_at":"2026-08-23T07:13:05.224Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1563gitlab # [ 179.627617] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.224Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"44b4e41b4420a093fc4297d6","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-44b4e41b4420a093fc4297d6: start","job_status":"start","queue_duration_s":0.759654,"scheduling_latency_s":0.759666}1564gitlab # [ 179.633717] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.234Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"44b4e41b4420a093fc4297d6","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-44b4e41b4420a093fc4297d6: done: 0.009224 sec","job_status":"done","queue_duration_s":0.759654,"scheduling_latency_s":0.759666,"redis_calls":13,"redis_duration_s":0.001554,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001046,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005677,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009224,"completed_at":"2026-08-23T07:13:05.234Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1565gitlab # [ 179.668416] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.235Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6590fae8c9d81a774d8ea078","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6590fae8c9d81a774d8ea078: start","job_status":"start","queue_duration_s":0.770472,"scheduling_latency_s":0.770486}1566gitlab # [ 179.674577] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.245Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6590fae8c9d81a774d8ea078","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6590fae8c9d81a774d8ea078: done: 0.009346 sec","job_status":"done","queue_duration_s":0.770472,"scheduling_latency_s":0.770486,"redis_calls":13,"redis_duration_s":0.0016259999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000573,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001053,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00608,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009346,"completed_at":"2026-08-23T07:13:05.245Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1567gitlab # [ 179.718029] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.245Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"befa3bb2570e7cbb3ba86c9d","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-befa3bb2570e7cbb3ba86c9d: start","job_status":"start","queue_duration_s":0.780639,"scheduling_latency_s":0.780653}1568gitlab # [ 179.718736] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.255Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"befa3bb2570e7cbb3ba86c9d","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-befa3bb2570e7cbb3ba86c9d: done: 0.009458 sec","job_status":"done","queue_duration_s":0.780639,"scheduling_latency_s":0.780653,"redis_calls":13,"redis_duration_s":0.001609,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001093,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006186,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009458,"completed_at":"2026-08-23T07:13:05.255Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1569gitlab # [ 179.769252] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.256Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc9fde559d815e575c88cb77","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc9fde559d815e575c88cb77: start","job_status":"start","queue_duration_s":0.791104,"scheduling_latency_s":0.791118}1570gitlab # [ 179.769981] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.265Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc9fde559d815e575c88cb77","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc9fde559d815e575c88cb77: done: 0.009522 sec","job_status":"done","queue_duration_s":0.791104,"scheduling_latency_s":0.791118,"redis_calls":13,"redis_duration_s":0.001626,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001082,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006159,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009522,"completed_at":"2026-08-23T07:13:05.265Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1571gitlab # [ 179.788181] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.266Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8998ea3a6941456ac3a65752","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8998ea3a6941456ac3a65752: start","job_status":"start","queue_duration_s":0.801458,"scheduling_latency_s":0.801471}1572gitlab # [ 179.829088] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.275Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8998ea3a6941456ac3a65752","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8998ea3a6941456ac3a65752: done: 0.009279 sec","job_status":"done","queue_duration_s":0.801458,"scheduling_latency_s":0.801471,"redis_calls":13,"redis_duration_s":0.0015860000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001064,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005692,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009279,"completed_at":"2026-08-23T07:13:05.275Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1573gitlab # [ 179.829951] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.277Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6eb62edbb34153cdb2a1af99","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6eb62edbb34153cdb2a1af99: start","job_status":"start","queue_duration_s":0.811906,"scheduling_latency_s":0.811919}1574gitlab # [ 179.839102] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.286Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6eb62edbb34153cdb2a1af99","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6eb62edbb34153cdb2a1af99: done: 0.00937 sec","job_status":"done","queue_duration_s":0.811906,"scheduling_latency_s":0.811919,"redis_calls":13,"redis_duration_s":0.0015639999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00105,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006105,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00937,"completed_at":"2026-08-23T07:13:05.286Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1575gitlab # [ 179.871129] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.287Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac555fef32ca23c7fa337107","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac555fef32ca23c7fa337107: start","job_status":"start","queue_duration_s":0.822086,"scheduling_latency_s":0.822099}1576gitlab # [ 179.913712] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.296Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac555fef32ca23c7fa337107","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac555fef32ca23c7fa337107: done: 0.009531 sec","job_status":"done","queue_duration_s":0.822086,"scheduling_latency_s":0.822099,"redis_calls":13,"redis_duration_s":0.001545,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00049,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001055,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006273,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009531,"completed_at":"2026-08-23T07:13:05.296Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1577gitlab # [ 179.914558] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.297Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0af6934b6cab4a4f7d4a8f4","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0af6934b6cab4a4f7d4a8f4: start","job_status":"start","queue_duration_s":0.832456,"scheduling_latency_s":0.832469}1578gitlab # [ 179.921636] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.306Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0af6934b6cab4a4f7d4a8f4","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0af6934b6cab4a4f7d4a8f4: done: 0.009233 sec","job_status":"done","queue_duration_s":0.832456,"scheduling_latency_s":0.832469,"redis_calls":13,"redis_duration_s":0.00162,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000584,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001036,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005984,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009233,"completed_at":"2026-08-23T07:13:05.306Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1579gitlab # [ 179.967272] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.307Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"326c0e17d3af571bb4d93593","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-326c0e17d3af571bb4d93593: start","job_status":"start","queue_duration_s":0.842523,"scheduling_latency_s":0.842536}1580gitlab # [ 179.967827] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.316Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"326c0e17d3af571bb4d93593","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-326c0e17d3af571bb4d93593: done: 0.009061 sec","job_status":"done","queue_duration_s":0.842523,"scheduling_latency_s":0.842536,"redis_calls":13,"redis_duration_s":0.001543,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00103,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005736,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009061,"completed_at":"2026-08-23T07:13:05.316Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1581gitlab # [ 180.020923] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.318Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7af3503e5f8eaaf4d8088a46","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7af3503e5f8eaaf4d8088a46: start","job_status":"start","queue_duration_s":0.852798,"scheduling_latency_s":0.852811}1582gitlab # [ 180.021624] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.329Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7af3503e5f8eaaf4d8088a46","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7af3503e5f8eaaf4d8088a46: done: 0.011672 sec","job_status":"done","queue_duration_s":0.852798,"scheduling_latency_s":0.852811,"redis_calls":13,"redis_duration_s":0.0017000000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001177,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006291,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011672,"completed_at":"2026-08-23T07:13:05.329Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1583gitlab # [ 180.035126] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.330Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea49fc71b0be2bea45ae2d0e","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea49fc71b0be2bea45ae2d0e: start","job_status":"start","queue_duration_s":0.865292,"scheduling_latency_s":0.865304}1584gitlab # [ 180.045211] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.342Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea49fc71b0be2bea45ae2d0e","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea49fc71b0be2bea45ae2d0e: done: 0.011727 sec","job_status":"done","queue_duration_s":0.865292,"scheduling_latency_s":0.865304,"redis_calls":13,"redis_duration_s":0.0016970000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001178,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00819,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011727,"completed_at":"2026-08-23T07:13:05.342Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1585gitlab # [ 180.085935] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.343Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a3d189151d828d3ce92fbd9","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a3d189151d828d3ce92fbd9: start","job_status":"start","queue_duration_s":0.878157,"scheduling_latency_s":0.878176}1586gitlab # [ 180.086592] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.353Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a3d189151d828d3ce92fbd9","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a3d189151d828d3ce92fbd9: done: 0.009792 sec","job_status":"done","queue_duration_s":0.878157,"scheduling_latency_s":0.878176,"redis_calls":13,"redis_duration_s":0.00149,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000479,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001011,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006414,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009792,"completed_at":"2026-08-23T07:13:05.353Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1587gitlab # [ 180.133848] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.353Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de16cbabffebe7e1ee01b8c5","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de16cbabffebe7e1ee01b8c5: start","job_status":"start","queue_duration_s":0.888715,"scheduling_latency_s":0.888736}1588gitlab # [ 180.134504] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.363Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de16cbabffebe7e1ee01b8c5","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de16cbabffebe7e1ee01b8c5: done: 0.009217 sec","job_status":"done","queue_duration_s":0.888715,"scheduling_latency_s":0.888736,"redis_calls":13,"redis_duration_s":0.0016120000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000599,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001013,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005737,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009217,"completed_at":"2026-08-23T07:13:05.363Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1589gitlab # [ 180.173849] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.364Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"201e9068e35865ad654c465f","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-201e9068e35865ad654c465f: start","job_status":"start","queue_duration_s":0.899122,"scheduling_latency_s":0.899135}1590gitlab # [ 180.174555] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.373Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"201e9068e35865ad654c465f","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-201e9068e35865ad654c465f: done: 0.008985 sec","job_status":"done","queue_duration_s":0.899122,"scheduling_latency_s":0.899135,"redis_calls":13,"redis_duration_s":0.001448,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000476,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000972,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006093,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008985,"completed_at":"2026-08-23T07:13:05.373Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1591gitlab # [ 180.209263] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.374Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27b5401db9ca429aba5e03c6","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27b5401db9ca429aba5e03c6: start","job_status":"start","queue_duration_s":0.908909,"scheduling_latency_s":0.908921}1592gitlab # [ 180.210145] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.387Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27b5401db9ca429aba5e03c6","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27b5401db9ca429aba5e03c6: done: 0.012899 sec","job_status":"done","queue_duration_s":0.908909,"scheduling_latency_s":0.908921,"redis_calls":13,"redis_duration_s":0.005201,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001202,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003999,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006255,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012899,"completed_at":"2026-08-23T07:13:05.387Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1593gitlab # [ 180.270956] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.387Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff4f0231c7cd613c442ebacb","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff4f0231c7cd613c442ebacb: start","job_status":"start","queue_duration_s":0.922621,"scheduling_latency_s":0.922634}1594gitlab # [ 180.271829] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.396Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff4f0231c7cd613c442ebacb","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff4f0231c7cd613c442ebacb: done: 0.00899 sec","job_status":"done","queue_duration_s":0.922621,"scheduling_latency_s":0.922634,"redis_calls":13,"redis_duration_s":0.001426,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000464,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000962,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006086,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00899,"completed_at":"2026-08-23T07:13:05.396Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1595gitlab # [ 180.307857] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.397Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb6a1a69cc3f65386023415c","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb6a1a69cc3f65386023415c: start","job_status":"start","queue_duration_s":0.932436,"scheduling_latency_s":0.932448}1596gitlab # [ 180.308747] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.406Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb6a1a69cc3f65386023415c","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb6a1a69cc3f65386023415c: done: 0.008902 sec","job_status":"done","queue_duration_s":0.932436,"scheduling_latency_s":0.932448,"redis_calls":13,"redis_duration_s":0.001485,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00047,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001015,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005599,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008902,"completed_at":"2026-08-23T07:13:05.406Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1597gitlab # [ 180.355228] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.407Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"337e30e957aa31c2bda1c3f3","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-337e30e957aa31c2bda1c3f3: start","job_status":"start","queue_duration_s":0.942492,"scheduling_latency_s":0.942504}1598gitlab # [ 180.356091] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.418Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"337e30e957aa31c2bda1c3f3","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-337e30e957aa31c2bda1c3f3: done: 0.011246 sec","job_status":"done","queue_duration_s":0.942492,"scheduling_latency_s":0.942504,"redis_calls":13,"redis_duration_s":0.0037400000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000485,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003255,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006053,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011246,"completed_at":"2026-08-23T07:13:05.418Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1599gitlab # [ 180.365214] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.419Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4687d7f6496671ddea2c1480","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4687d7f6496671ddea2c1480: start","job_status":"start","queue_duration_s":0.954588,"scheduling_latency_s":0.954601}1600gitlab # [ 180.376884] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.428Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4687d7f6496671ddea2c1480","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4687d7f6496671ddea2c1480: done: 0.009014 sec","job_status":"done","queue_duration_s":0.954588,"scheduling_latency_s":0.954601,"redis_calls":13,"redis_duration_s":0.0014500000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000485,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000965,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006121,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009014,"completed_at":"2026-08-23T07:13:05.428Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1601gitlab # [ 180.412648] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.429Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2cc0760bdae061e253e6d6c8","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2cc0760bdae061e253e6d6c8: start","job_status":"start","queue_duration_s":0.964409,"scheduling_latency_s":0.964422}1602gitlab # [ 180.419629] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.438Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2cc0760bdae061e253e6d6c8","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2cc0760bdae061e253e6d6c8: done: 0.008894 sec","job_status":"done","queue_duration_s":0.964409,"scheduling_latency_s":0.964422,"redis_calls":13,"redis_duration_s":0.001451,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000469,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000982,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006024,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008894,"completed_at":"2026-08-23T07:13:05.438Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1603gitlab # [ 180.455322] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.439Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac472e6e04f3faf33a43c714","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac472e6e04f3faf33a43c714: start","job_status":"start","queue_duration_s":0.974069,"scheduling_latency_s":0.974081}1604gitlab # [ 180.457694] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.448Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac472e6e04f3faf33a43c714","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac472e6e04f3faf33a43c714: done: 0.009548 sec","job_status":"done","queue_duration_s":0.974069,"scheduling_latency_s":0.974081,"redis_calls":13,"redis_duration_s":0.001437,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000475,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000962,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005657,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009548,"completed_at":"2026-08-23T07:13:05.448Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1605gitlab # [ 180.498191] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.449Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6025b4733bd3a11831a97d0e","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6025b4733bd3a11831a97d0e: start","job_status":"start","queue_duration_s":0.984642,"scheduling_latency_s":0.984655}1606gitlab # [ 180.498814] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.464Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6025b4733bd3a11831a97d0e","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6025b4733bd3a11831a97d0e: done: 0.014392 sec","job_status":"done","queue_duration_s":0.984642,"scheduling_latency_s":0.984655,"redis_calls":13,"redis_duration_s":0.002879,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001466,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001413,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006318,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014392,"completed_at":"2026-08-23T07:13:05.464Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1607gitlab # [ 180.549873] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.465Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a21cb3b87f0c918440375159","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a21cb3b87f0c918440375159: start","job_status":"start","queue_duration_s":0.999843,"scheduling_latency_s":0.999856}1608gitlab # [ 180.550581] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.474Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a21cb3b87f0c918440375159","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a21cb3b87f0c918440375159: done: 0.009422 sec","job_status":"done","queue_duration_s":0.999843,"scheduling_latency_s":0.999856,"redis_calls":13,"redis_duration_s":0.001454,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000484,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00097,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006485,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009422,"completed_at":"2026-08-23T07:13:05.474Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1609gitlab # [ 180.587536] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.475Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d474b4e63c5e45c7dd288f9","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d474b4e63c5e45c7dd288f9: start","job_status":"start","queue_duration_s":1.010031,"scheduling_latency_s":1.010044}1610gitlab # [ 180.588223] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.483Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d474b4e63c5e45c7dd288f9","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d474b4e63c5e45c7dd288f9: done: 0.008477 sec","job_status":"done","queue_duration_s":1.010031,"scheduling_latency_s":1.010044,"redis_calls":13,"redis_duration_s":0.0014320000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00046,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000972,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005623,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008477,"completed_at":"2026-08-23T07:13:05.483Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1611gitlab # [ 180.638103] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.485Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abf3c11eeb80daaf6918e11f","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abf3c11eeb80daaf6918e11f: start","job_status":"start","queue_duration_s":1.0198,"scheduling_latency_s":1.019816}1612gitlab # [ 180.638715] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.498Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abf3c11eeb80daaf6918e11f","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abf3c11eeb80daaf6918e11f: done: 0.013553 sec","job_status":"done","queue_duration_s":1.0198,"scheduling_latency_s":1.019816,"redis_calls":13,"redis_duration_s":0.005502,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001027,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004475,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005799,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013553,"completed_at":"2026-08-23T07:13:05.498Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1613gitlab # [ 180.681538] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.501Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"168e7123d9f92abacbc25448","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-168e7123d9f92abacbc25448: start","job_status":"start","queue_duration_s":1.036414,"scheduling_latency_s":1.036428}1614gitlab # [ 180.682233] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.519Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"168e7123d9f92abacbc25448","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-168e7123d9f92abacbc25448: done: 0.018194 sec","job_status":"done","queue_duration_s":1.036414,"scheduling_latency_s":1.036428,"redis_calls":13,"redis_duration_s":0.009618,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00238,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007238,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006272,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018194,"completed_at":"2026-08-23T07:13:05.519Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1615gitlab # [ 180.719130] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.522Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47a8e08e1ba44667d02c779a","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47a8e08e1ba44667d02c779a: start","job_status":"start","queue_duration_s":1.057404,"scheduling_latency_s":1.057418}1616gitlab # [ 180.719737] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.539Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47a8e08e1ba44667d02c779a","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47a8e08e1ba44667d02c779a: done: 0.017251 sec","job_status":"done","queue_duration_s":1.057404,"scheduling_latency_s":1.057418,"redis_calls":13,"redis_duration_s":0.008631,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002184,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006447,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006293,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017251,"completed_at":"2026-08-23T07:13:05.539Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1617gitlab # [ 180.759065] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.540Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"634eb839db75d22c93439b1e","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-634eb839db75d22c93439b1e: start","job_status":"start","queue_duration_s":1.075494,"scheduling_latency_s":1.075507}1618gitlab # [ 180.759726] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.552Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"634eb839db75d22c93439b1e","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-634eb839db75d22c93439b1e: done: 0.011775 sec","job_status":"done","queue_duration_s":1.075494,"scheduling_latency_s":1.075507,"redis_calls":13,"redis_duration_s":0.00397,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00049,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00348,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006096,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011775,"completed_at":"2026-08-23T07:13:05.552Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1619gitlab # [ 180.801573] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.556Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a4ee48a98b7d4dda3c9c2628","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a4ee48a98b7d4dda3c9c2628: start","job_status":"start","queue_duration_s":1.090871,"scheduling_latency_s":1.090885}1620gitlab # [ 180.802444] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.568Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a4ee48a98b7d4dda3c9c2628","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a4ee48a98b7d4dda3c9c2628: done: 0.012536 sec","job_status":"done","queue_duration_s":1.090871,"scheduling_latency_s":1.090885,"redis_calls":13,"redis_duration_s":0.004272,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002924,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001348,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006467,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012536,"completed_at":"2026-08-23T07:13:05.568Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1621gitlab # [ 180.818367] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.569Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"352870f05a61eb9b842b57dd","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-352870f05a61eb9b842b57dd: start","job_status":"start","queue_duration_s":1.104215,"scheduling_latency_s":1.104228}1622gitlab # [ 180.828521] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:05.581Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"352870f05a61eb9b842b57dd","created_at":"2026-08-23T07:13:04.387Z","trace_propagation_headers":{"sentry-trace":"6121059da463419db1ec962d678e99d1-84bc1c13bf004010","baggage":"sentry-trace_id=6121059da463419db1ec962d678e99d1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"85937f2f6f48b487a3cf4d08bf3e35cb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:04.465Z","job_size_bytes":2,"pid":1614,"sidekiq_tid":"mae2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-352870f05a61eb9b842b57dd: done: 0.012519 sec","job_status":"done","queue_duration_s":1.104215,"scheduling_latency_s":1.104228,"redis_calls":13,"redis_duration_s":0.004984,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000469,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004515,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006096,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012519,"completed_at":"2026-08-23T07:13:05.581Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1623gitlab # [ 180.907150] postgres[2422]: [2422] ERROR: relation "table_without_models" does not exist1624gitlab # [ 180.907675] postgres[2422]: [2422] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1625gitlab # [ 184.400539] runuser[2218]: pam_unix(runuser:session): session closed for user gitlab1626gitlab # [ 184.403719] setup-gitlab-start[2200]: + systemctl restart gitlab-sidekiq.service1627gitlab # [ 184.420950] systemd[1]: Stopping gitlab-sidekiq.service...1628gitlab # [ 184.423321] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:10.444Z","message":"Shutting down"}1629gitlab # [ 184.533577] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:10.556Z","message":"Scheduler exiting..."}1630gitlab # [ 184.535251] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:10.557Z","message":"Terminating quiet threads for default capsule"}1631gitlab # [ 184.540497] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:10.563Z","message":"Scheduler exiting..."}1632gitlab # [ 185.044349] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:11.067Z","message":"Bye!"}1633gitlab # [ 185.069533] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-08-23T07:13:11.092Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1614,"worker_id":"sidekiq_0","memwd_rss_bytes":971948032,"retry":0}1634gitlab # [ 185.644507] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1635gitlab # [ 185.646119] systemd[1]: Stopped gitlab-sidekiq.service.1636gitlab # [ 185.648101] systemd[1]: gitlab-sidekiq.service: Consumed 58.206s CPU time over 1min 53.067s wall clock time, 968.7M memory peak, 4.4M read from disk.1637gitlab # [ 185.651617] systemd[1]: Started gitlab-sidekiq.service.1638gitlab # [ 185.656086] setup-gitlab-start[2200]: + mkdir -p /var/lib/secrets1639gitlab # [ 185.658855] setup-gitlab-start[2200]: + echo nixbot-test-token-of-20-chars1640gitlab # [ 185.660325] setup-gitlab-start[2200]: + chmod 644 /var/lib/secrets/gitlab-token1641gitlab # [ 185.662356] setup-gitlab-start[2200]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1642gitlab # [ 186.245150] gitaly[923]: time="2026-08-23T07:13:12.267Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEPGPTZQ1WGDDY4FNADY9 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T07:13:22.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:13:12.267" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1643gitlab # [ 186.246706] gitaly[923]: time="2026-08-23T07:13:12.268Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEPGPTZQ1WGDDY4FNADY9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T07:13:22.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:13:12.267" grpc.time_ms=0.528 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1644gitlab # [ 186.367451] gitaly[923]: time="2026-08-23T07:13:12.390Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEPGPTZQ1WGDDY4FNADY9 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T07:13:22.129" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:13:12.390" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1645gitlab # [ 186.388452] gitaly[923]: time="2026-08-23T07:13:12.390Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEPGPTZQ1WGDDY4FNADY9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T07:13:22.129" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:13:12.390" grpc.time_ms=0.426 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1646gitlab # [ 186.433187] gitaly[923]: time="2026-08-23T07:13:12.456Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEPGPTZQ1WGDDY4FNADY9 diskcache=7ddf7c0b-31e0-494d-b7cb-3c23fd1bafa6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-23T07:13:22.155" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:13:12.415" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1647gitlab # [ 186.434963] gitaly[923]: time="2026-08-23T07:13:12.456Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1574 command.oublock=32 command.real_time_ms=13 command.spawn_token_fork_ms=4 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEPGPTZQ1WGDDY4FNADY9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-23T07:13:22.155" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:13:12.415" grpc.time_ms=40.668 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1648gitlab # [ 186.442789] gitaly[923]: time="2026-08-23T07:13:12.466Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEPGPTZQ1WGDDY4FNADY9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T07:13:22.205" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:13:12.465" pid=923 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1649gitlab # [ 186.443796] gitaly[923]: time="2026-08-23T07:13:12.466Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEPGPTZQ1WGDDY4FNADY9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T07:13:22.205" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:13:12.465" grpc.time_ms=0.607 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1650gitlab # [ 186.452594] gitaly[923]: time="2026-08-23T07:13:12.475Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEPGPTZQ1WGDDY4FNADY9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-23T07:13:22.210" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:13:12.470" grpc.time_ms=5.194 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1651gitlab # [ 186.499559] gitaly[923]: time="2026-08-23T07:13:12.522Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEPGPTZQ1WGDDY4FNADY9 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T07:13:22.262" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:13:12.522" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1652gitlab # [ 186.500421] gitaly[923]: time="2026-08-23T07:13:12.523Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEPGPTZQ1WGDDY4FNADY9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T07:13:22.262" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:13:12.522" grpc.time_ms=0.28 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1653gitlab # [ 186.536832] gitaly[923]: time="2026-08-23T07:13:12.560Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEPGPTZQ1WGDDY4FNADY9 diskcache=9fc85892-dc4b-4581-8546-b456dacc1bc2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-23T07:13:22.265" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:13:12.525" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1654gitlab # [ 186.545359] gitaly[923]: time="2026-08-23T07:13:12.568Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1570 command.oublock=32 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEPGPTZQ1WGDDY4FNADY9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-23T07:13:22.265" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:13:12.525" grpc.time_ms=34.422 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1655gitlab # [ 186.561552] gitaly[923]: time="2026-08-23T07:13:12.584Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEPGPTZQ1WGDDY4FNADY9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T07:13:22.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:13:12.584" pid=923 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1656gitlab # [ 186.562058] gitaly[923]: time="2026-08-23T07:13:12.585Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEPGPTZQ1WGDDY4FNADY9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T07:13:22.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:13:12.584" grpc.time_ms=0.617 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1657gitlab # [ 186.569994] gitaly[923]: time="2026-08-23T07:13:12.593Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEPGPTZQ1WGDDY4FNADY9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-23T07:13:22.007" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:13:12.588" grpc.time_ms=4.874 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1658gitlab # [ 186.594556] gitaly[923]: time="2026-08-23T07:13:12.617Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEPGPTZQ1WGDDY4FNADY9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T07:13:22.037" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:13:12.617" grpc.time_ms=0.124 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1659gitlab # [ 186.609223] gitaly[923]: time="2026-08-23T07:13:12.632Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEPGPTZQ1WGDDY4FNADY9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-23T07:13:22.051" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:13:12.632" grpc.time_ms=0.167 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1660gitlab # [ 187.057523] gitaly[923]: time="2026-08-23T07:13:13.080Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEPGPTZQ1WGDDY4FNADY9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-23T07:13:23.002" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:13:13.072" grpc.time_ms=7.366 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1661gitlab # [ 187.290942] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:13:13 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 16081662gitlab # [ 187.292835] setup-gitlab-start[2200]: + mkdir -p /tmp/test-flake1663gitlab # [ 187.296114] setup-gitlab-start[2200]: + cd /tmp/test-flake1664gitlab # [ 187.298255] setup-gitlab-start[2200]: + git init -b master1665gitlab # [ 187.316975] setup-gitlab-start[2495]: Initialized empty Git repository in /tmp/test-flake/.git/1666gitlab # [ 187.318481] setup-gitlab-start[2200]: + git config user.name test1667gitlab # [ 187.324585] setup-gitlab-start[2200]: + git config user.email test@example.com1668gitlab # [ 187.328831] setup-gitlab-start[2200]: + cat1669gitlab # [ 187.331302] setup-gitlab-start[2200]: + git add flake.nix1670gitlab # [ 187.338521] setup-gitlab-start[2200]: + git commit -m 'initial commit'1671gitlab # [ 187.359237] setup-gitlab-start[2500]: [master (root-commit) 3646acb] initial commit1672gitlab # [ 187.362050] setup-gitlab-start[2500]: 1 file changed, 10 insertions(+)1673gitlab # [ 187.363455] setup-gitlab-start[2500]: create mode 100644 flake.nix1674gitlab # [ 187.365058] setup-gitlab-start[2200]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1675gitlab # [ 187.369324] setup-gitlab-start[2200]: + git push -u origin master1676gitlab # [ 187.741506] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:13:13 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 3391677gitlab # [ 187.867441] gitaly[923]: time="2026-08-23T07:13:13.889Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQERHACY3YAE194DT4FZ3Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:13:13.878" grpc.time_ms=11.049 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1678gitlab # [ 187.869460] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:13:13 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 1201679gitlab # [ 188.324166] gitaly[923]: time="2026-08-23T07:13:14.347Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=619 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQERPD61XC06C394QS1VT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-23T07:13:24.076" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:13:14.336" grpc.time_ms=10.171 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1680gitlab # [ 188.392209] gitaly[923]: time="2026-08-23T07:13:14.415Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=331 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQERPD61XC06C394QS1VT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-23T07:13:44.003" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-23T07:13:14.403" grpc.time_ms=11.747 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1681gitlab # [ 188.407029] gitaly[923]: time="2026-08-23T07:13:14.430Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M0PQERPD61XC06C394QS1VT8 duration_ms=148ns method=POST pid=923 status=200 url="http://unix/api/v4/internal/allowed"1682gitlab # [ 188.427831] gitaly[923]: time="2026-08-23T07:13:14.451Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M0PQERPD61XC06C394QS1VT8 duration_ms=20ns method=POST pid=923 status=200 url="http://unix/api/v4/internal/pre_receive"1683gitlab # [ 188.428785] gitaly[923]: time="2026-08-23T07:13:14.451Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQERPD61XC06C394QS1VT8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5306 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:13:14.279" grpc.time_ms=171.92 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1684gitlab # [ 188.471510] gitaly[923]: time="2026-08-23T07:13:14.494Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQERPD61XC06C394QS1VT8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4776 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:13:14.492" grpc.time_ms=1.88 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1685gitlab # [ 188.503108] gitaly[923]: time="2026-08-23T07:13:14.526Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQERPD61XC06C394QS1VT8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4775 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:13:14.525" grpc.time_ms=0.395 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1686gitlab # [ 188.530272] gitaly[923]: time="2026-08-23T07:13:14.553Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQERPD61XC06C394QS1VT8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4777 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:13:14.553" grpc.time_ms=0.251 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1687gitlab # [ 188.654302] sidekiq-cluster[2448]: {"severity":"INFO","time":"2026-08-23T07:13:14.660Z","message":"Starting cluster with 1 processes"}1688gitlab # [ 188.694847] gitaly[923]: time="2026-08-23T07:13:14.717Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQERPD61XC06C394QS1VT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-23T07:13:24.001" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:13:14.711" grpc.time_ms=5.542 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1689gitlab # [ 188.724500] gitaly[923]: time="2026-08-23T07:13:14.743Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1567 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=3 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQERPD61XC06C394QS1VT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-23T07:13:24.019" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:13:14.730" grpc.time_ms=12.817 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1690gitlab # [ 188.751933] gitaly[923]: time="2026-08-23T07:13:14.775Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M0PQERPD61XC06C394QS1VT8 duration_ms=195ns method=POST pid=923 status=200 url="http://unix/api/v4/internal/post_receive"1691gitlab # [ 188.756737] gitaly[923]: time="2026-08-23T07:13:14.776Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQERPD61XC06C394QS1VT8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4800 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:13:14.579" grpc.time_ms=196.49 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1692gitlab # [ 188.768198] gitaly[923]: time="2026-08-23T07:13:14.789Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M0PQERPD61XC06C394QS1VT8 diskcache=a6185a3a-d652-4395-aa4e-de6a38338e81 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:13:14.199" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1693gitlab # [ 188.769069] gitlab-workhorse[825]: time="2026-08-23T07:13:14Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521694gitlab # [ 188.769597] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:13:14 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 8561695gitlab # [ 188.770123] gitaly[923]: time="2026-08-23T07:13:14.789Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=158 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13504 command.oublock=32 command.real_time_ms=580 command.spawn_token_fork_ms=0 command.system_time_ms=101 command.user_time_ms=57 component=gitaly.StreamServerInterceptor correlation_id=01M0PQERPD61XC06C394QS1VT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:13:14.199" grpc.time_ms=589.761 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1696gitlab # [ 188.770654] setup-gitlab-start[2504]: To http://gitlab/root/test-flake.git1697gitlab # [ 188.771215] setup-gitlab-start[2504]: * [new branch] master -> master1698gitlab # [ 188.793259] setup-gitlab-start[2504]: branch 'master' set up to track 'origin/master'.1699gitlab # [ 188.796201] systemd[1]: Finished setup-gitlab.service.1700gitlab # [ 188.799173] systemd[1]: Starting nixbot CI service...1701gitlab: (finished: waiting for unit setup-gitlab.service, in 189.88 seconds)1702gitlab: waiting for unit nixbot.service1703gitlab # [ 190.015731] nixbot[2596]: {"ts": "2026-08-23T07:13:16.038Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1704gitlab # [ 190.043395] nixbot[2596]: {"ts": "2026-08-23T07:13:16.066Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1705gitlab # [ 190.072273] nixbot[2596]: {"ts": "2026-08-23T07:13:16.095Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1706gitlab # [ 190.077891] nixbot[2596]: {"ts": "2026-08-23T07:13:16.101Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1707gitlab # [ 190.082860] nixbot[2596]: {"ts": "2026-08-23T07:13:16.105Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1708gitlab # [ 190.090937] nixbot[2596]: {"ts": "2026-08-23T07:13:16.114Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1709gitlab # [ 190.096444] nixbot[2596]: {"ts": "2026-08-23T07:13:16.118Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1710gitlab # [ 190.103785] nixbot[2596]: {"ts": "2026-08-23T07:13:16.126Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1711gitlab # [ 190.116939] nixbot[2596]: {"ts": "2026-08-23T07:13:16.140Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1712gitlab # [ 190.124746] nixbot[2596]: {"ts": "2026-08-23T07:13:16.147Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1713gitlab # [ 190.138617] nixbot[2596]: {"ts": "2026-08-23T07:13:16.161Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1714gitlab # [ 190.152194] nixbot[2596]: {"ts": "2026-08-23T07:13:16.175Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1715gitlab # [ 190.162523] nixbot[2596]: {"ts": "2026-08-23T07:13:16.185Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1716gitlab # [ 190.170581] nixbot[2596]: {"ts": "2026-08-23T07:13:16.193Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1717gitlab # [ 190.180841] nixbot[2596]: {"ts": "2026-08-23T07:13:16.204Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1718gitlab # [ 190.188646] nixbot[2596]: {"ts": "2026-08-23T07:13:16.211Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1719gitlab # [ 190.196650] nixbot[2596]: {"ts": "2026-08-23T07:13:16.219Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1720gitlab # [ 190.204236] nixbot[2596]: {"ts": "2026-08-23T07:13:16.227Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1721gitlab # [ 190.215432] nixbot[2596]: {"ts": "2026-08-23T07:13:16.238Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1722gitlab # [ 190.222864] nixbot[2596]: {"ts": "2026-08-23T07:13:16.246Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1723gitlab # [ 190.230635] nixbot[2596]: {"ts": "2026-08-23T07:13:16.253Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1724gitlab # [ 190.242731] nixbot[2596]: {"ts": "2026-08-23T07:13:16.265Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1725gitlab # [ 190.250827] nixbot[2596]: {"ts": "2026-08-23T07:13:16.274Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1726gitlab # [ 190.259088] nixbot[2596]: {"ts": "2026-08-23T07:13:16.282Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1727gitlab # [ 190.266502] nixbot[2596]: {"ts": "2026-08-23T07:13:16.289Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1728gitlab # [ 190.635122] nixbot[2596]: INFO: Started server process [2596]1729gitlab # [ 190.637147] nixbot[2596]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1730gitlab # [ 190.652649] nixbot[2596]: INFO: ::ffff:127.0.0.1:46916 - "GET /health HTTP/1.1" 200 OK1731gitlab # [ 190.661370] systemd[1]: Started nixbot CI service.1732gitlab # [ 190.665496] systemd[1]: Reached target Multi-User System.1733gitlab # [ 190.667613] systemd[1]: Startup finished in 1.183s (kernel) + 2.834s (initrd) + 3min 6.649s (userspace) = 3min 10.667s.1734gitlab # [ 190.897385] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:13:16 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 2461735gitlab # [ 190.899195] nixbot[2596]: {"ts": "2026-08-23T07:13:16.921Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1736gitlab # [ 190.920757] nixbot[2596]: {"ts": "2026-08-23T07:13:16.943Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1737gitlab # [ 190.990769] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:13:17 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 531738gitlab # [ 190.992430] nixbot[2596]: {"ts": "2026-08-23T07:13:17.014Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1739gitlab # [ 190.993558] nixbot[2596]: {"ts": "2026-08-23T07:13:17.015Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1740gitlab # [ 191.070080] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:13:17 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 751741gitlab # [ 191.075721] nixbot[2596]: {"ts": "2026-08-23T07:13:17.094Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1742gitlab: (finished: waiting for unit nixbot.service, in 2.09 seconds)1743gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1744gitlab # [ 191.378287] nixbot[2596]: INFO: ::ffff:127.0.0.1:46932 - "GET /health HTTP/1.1" 200 OK1745gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.04 seconds)1746subtest: project discovered and webhook registered1747gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1748gitlab # [ 191.481743] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:13:17 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 621749gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.10 seconds)1750(finished: subtest: project discovered and webhook registered, in 0.10 seconds)1751subtest: push delivers the webhook1752gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1753gitlab # [ 191.616078] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:13:17 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 961754gitlab # [ 191.687459] gitaly[923]: time="2026-08-23T07:13:17.709Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0PQEWADSMAS0PA17HTNNNQJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:13:17.698" grpc.time_ms=11.8 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1755gitlab # [ 191.716832] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:13:17 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 651756gitlab # Enumerating objects: 5, done.1757gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1758gitlab # Delta compression using up to 4 threads1759gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1760gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 273.00 KiB/s, done.1761gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1762gitlab # [ 191.755141] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:13:17 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 6741763gitlab # [ 191.757321] nixbot[2596]: {"ts": "2026-08-23T07:13:17.779Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1764gitlab # [ 191.841101] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:13:17 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 751765gitlab # [ 191.843483] nixbot[2596]: {"ts": "2026-08-23T07:13:17.864Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1766gitlab # [ 191.890038] gitaly[923]: time="2026-08-23T07:13:17.913Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=328 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQEWDY51YW9A7KXEFMDKX9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-23T07:13:47.506" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-23T07:13:17.906" grpc.time_ms=6.291 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1767gitlab # [ 191.908521] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:13:17 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 641768gitlab # [ 191.910390] nixbot[2596]: {"ts": "2026-08-23T07:13:17.932Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1769gitlab # [ 191.912764] gitaly[923]: time="2026-08-23T07:13:17.935Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M0PQEWDY51YW9A7KXEFMDKX9 duration_ms=72ns method=POST pid=923 status=200 url="http://unix/api/v4/internal/allowed"1770gitlab # [ 191.937079] gitaly[923]: time="2026-08-23T07:13:17.960Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M0PQEWDY51YW9A7KXEFMDKX9 duration_ms=24ns method=POST pid=923 status=200 url="http://unix/api/v4/internal/pre_receive"1771gitlab # [ 191.940145] gitaly[923]: time="2026-08-23T07:13:17.963Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQEWDY51YW9A7KXEFMDKX9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5306 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:13:17.862" grpc.time_ms=101.138 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1772gitlab # [ 191.966326] gitaly[923]: time="2026-08-23T07:13:17.989Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEWKMB243CECBMH1Y0E74 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-23T07:13:47.581" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:13:17.981" grpc.time_ms=7.691 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1773gitlab # [ 191.979236] gitaly[923]: time="2026-08-23T07:13:17.995Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQEWDY51YW9A7KXEFMDKX9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4776 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:13:17.995" grpc.time_ms=0.35 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1774gitlab # [ 191.988110] gitaly[923]: time="2026-08-23T07:13:18.004Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEWKMB243CECBMH1Y0E74 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:13:48.003" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:13:18.003" grpc.time_ms=0.438 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1775gitlab # [ 192.000999] gitaly[923]: time="2026-08-23T07:13:18.024Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=7 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEWKMB243CECBMH1Y0E74 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-23T07:13:28.002" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:13:18.013" grpc.time_ms=11.076 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1776gitlab # [ 192.011920] gitaly[923]: time="2026-08-23T07:13:18.027Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQEWDY51YW9A7KXEFMDKX9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4775 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:13:18.026" grpc.time_ms=0.774 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1777gitlab # [ 192.025342] nixbot[2596]: {"ts": "2026-08-23T07:13:18.048Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1778gitlab # [ 192.027237] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:13:18 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 1091779gitlab # [ 192.040258] gitaly[923]: time="2026-08-23T07:13:18.063Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQEWDY51YW9A7KXEFMDKX9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4777 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:13:18.063" grpc.time_ms=0.36 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1780gitlab # [ 192.088440] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:13:18 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 591781gitlab # [ 192.090898] nixbot[2596]: {"ts": "2026-08-23T07:13:18.112Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1782gitlab # [ 192.093184] nixbot[2596]: {"ts": "2026-08-23T07:13:18.114Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1783gitlab # [ 192.111136] gitaly[923]: time="2026-08-23T07:13:18.134Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M0PQEWDY51YW9A7KXEFMDKX9 duration_ms=40ns method=POST pid=923 status=200 url="http://unix/api/v4/internal/post_receive"1784gitlab # [ 192.113794] gitaly[923]: time="2026-08-23T07:13:18.137Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQEWDY51YW9A7KXEFMDKX9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4800 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:13:18.093" grpc.time_ms=43.213 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1785gitlab # [ 192.130090] gitaly[923]: time="2026-08-23T07:13:18.153Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M0PQEWDY51YW9A7KXEFMDKX9 diskcache=ecc612f6-f1c5-4356-9781-c45e5f0193c5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:13:17.811" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1786gitlab # [ 192.130766] gitaly[923]: time="2026-08-23T07:13:18.154Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=134 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13579 command.oublock=32 command.real_time_ms=334 command.spawn_token_fork_ms=1 command.system_time_ms=89 command.user_time_ms=45 component=gitaly.StreamServerInterceptor correlation_id=01M0PQEWDY51YW9A7KXEFMDKX9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:13:17.811" grpc.time_ms=342.149 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1787gitlab # [ 192.131989] gitlab-workhorse[825]: time="2026-08-23T07:13:18Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521788gitlab # [ 192.132622] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:13:18 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 3961789gitlab # To http://gitlab/root/test-flake.git1790gitlab # 3646acb..980b228 master -> master1791gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.67 seconds)1792gitlab: must succeed: git -C /tmp/test-flake rev-parse master1793gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1794gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1795gitlab # [ 192.171961] gitaly[923]: time="2026-08-23T07:13:18.195Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQEWT3WMZ6096KG7C2B0YW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:13:18.186" grpc.time_ms=8.617 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc1796gitlab # [ 192.173496] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:13:18 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 491797gitlab # [ 192.233188] nixbot[2596]: INFO: ::ffff:127.0.0.1:46934 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1798gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.06 seconds)1799gitlab # [ 192.237136] gitaly[923]: time="2026-08-23T07:13:18.260Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEWVN721ABSQVS0M6514K grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:13:18.251" pid=923 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1800gitlab # [ 192.245345] gitaly[923]: time="2026-08-23T07:13:18.260Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEWVN721ABSQVS0M6514K grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:13:18.251" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc1801gitlab # [ 192.256708] gitaly[923]: time="2026-08-23T07:13:18.280Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEWVN721ABSQVS0M6514K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:13:18.251" grpc.time_ms=28.474 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc1802gitlab # [ 192.268820] gitlab-workhorse[825]: time="2026-08-23T07:13:18Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131803gitlab # [ 192.269435] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:13:18 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 941804gitlab # [ 192.321917] gitaly[923]: time="2026-08-23T07:13:18.345Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEWYS4Y279W9SGYGH74K4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:13:18.331" pid=923 remote_ip="2001:db8:1::1" request_sha=59c5f4ca855baef27892bde8f178091fd355de98 response_bytes=417 span.kind=server system=grpc1805gitlab # [ 192.322610] gitaly[923]: time="2026-08-23T07:13:18.345Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1197 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEWYS4Y279W9SGYGH74K4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:13:18.331" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc1806gitlab # [ 192.341128] gitaly[923]: time="2026-08-23T07:13:18.364Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1197 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEWYS4Y279W9SGYGH74K4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:13:18.331" grpc.time_ms=33.177 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc1807gitlab # [ 192.352963] gitlab-workhorse[825]: time="2026-08-23T07:13:18Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=4171808gitlab # [ 192.353533] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:13:18 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 417 "" "git/2.55.0" 781809gitlab # [ 192.449091] gitaly[923]: time="2026-08-23T07:13:18.472Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0PQEX2MXHS1CX6QTH3W9E76 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:13:18.460" grpc.time_ms=12.093 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc1810gitlab # [ 192.474455] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:13:18 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 521811gitlab # [ 192.540950] gitaly[923]: time="2026-08-23T07:13:18.564Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEX576QYKANS0SYBYKJWA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:13:18.554" pid=923 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1812gitlab # [ 192.561471] gitaly[923]: time="2026-08-23T07:13:18.564Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEX576QYKANS0SYBYKJWA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:13:18.554" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc1813gitlab # [ 192.583366] gitlab-workhorse[825]: time="2026-08-23T07:13:18Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671814gitlab # [ 192.586248] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:13:18 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 621815gitlab # [ 192.587948] gitaly[923]: time="2026-08-23T07:13:18.564Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEX576QYKANS0SYBYKJWA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:13:18.554" grpc.time_ms=10.489 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc1816gitlab # [ 192.671899] gitaly[923]: time="2026-08-23T07:13:18.695Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQEX9W2E68WKR3S9S7QRBF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:13:18.685" grpc.time_ms=9.789 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc1817gitlab # [ 192.673184] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:13:18 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 431818gitlab # [ 192.766983] gitaly[923]: time="2026-08-23T07:13:18.789Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEXC49TXP740FPYBPCTM4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:13:18.769" pid=923 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1819gitlab # [ 192.768129] gitaly[923]: time="2026-08-23T07:13:18.790Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1167 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEXC49TXP740FPYBPCTM4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:13:18.769" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc1820gitlab # [ 192.808785] gitaly[923]: time="2026-08-23T07:13:18.831Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1167 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEXC49TXP740FPYBPCTM4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:13:18.769" grpc.time_ms=62.606 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc1821gitlab # [ 192.820734] gitlab-workhorse[825]: time="2026-08-23T07:13:18Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091822gitlab # [ 192.821440] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:13:18 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 1191823gitlab # [ 192.900190] gitaly[923]: time="2026-08-23T07:13:18.923Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEXH0ES8SKGJ91J3Y2W5D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:13:48.021" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:13:18.922" grpc.time_ms=0.859 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1824gitlab # [ 192.943863] gitaly[923]: time="2026-08-23T07:13:18.967Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=651 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0PQEXH0ES8SKGJ91J3Y2W5D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-23T07:13:48.058" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:13:18.958" grpc.time_ms=8.746 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1825gitlab # [ 192.990668] gitaly[923]: time="2026-08-23T07:13:19.013Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0PQEXH0ES8SKGJ91J3Y2W5D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:13:29.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:13:19.005" grpc.time_ms=8.491 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1826gitlab # [ 193.024445] gitaly[923]: time="2026-08-23T07:13:19.047Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQEXH0ES8SKGJ91J3Y2W5D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:13:29.039" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:13:19.039" grpc.time_ms=7.879 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1827gitlab # [ 193.118495] gitaly[923]: time="2026-08-23T07:13:19.141Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEXH0ES8SKGJ91J3Y2W5D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-23T07:13:29.140" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:13:19.141" grpc.time_ms=0.427 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1828gitlab # [ 193.161410] gitaly[923]: time="2026-08-23T07:13:19.184Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=620 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEXH0ES8SKGJ91J3Y2W5D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-23T07:13:29.172" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:13:19.172" grpc.time_ms=11.54 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1829gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1830gitlab # [ 193.244882] gitaly[923]: time="2026-08-23T07:13:19.267Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQEXH0ES8SKGJ91J3Y2W5D grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4146 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:13:19.265" grpc.time_ms=1.271 pid=923 span.kind=server system=grpc1831gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.06 seconds)1832gitlab # [ 193.282694] gitaly[923]: time="2026-08-23T07:13:19.305Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQEXH0ES8SKGJ91J3Y2W5D grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:13:19.305" grpc.time_ms=0.305 pid=923 span.kind=server system=grpc1833gitlab # [ 193.288677] nixbot[2596]: INFO: ::ffff:127.0.0.1:59300 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1834gitlab # [ 193.308691] gitaly[923]: time="2026-08-23T07:13:19.331Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEXH0ES8SKGJ91J3Y2W5D diskcache=3c7cbf15-e614-41c7-b58d-c3854f081c9a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-23T07:13:29.212" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:13:19.213" pid=923 ref=refs/keep-around/3646acbf947650c454ec92b605947ed1f4893ec6 remote_ip="2001:db8:1::1" revision=3646acbf947650c454ec92b605947ed1f4893ec6 span.kind=server system=grpc username=root1835gitlab # [ 193.309649] gitaly[923]: time="2026-08-23T07:13:19.332Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=86 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5282 command.oublock=8 command.real_time_ms=109 command.spawn_token_fork_ms=1 command.system_time_ms=57 command.user_time_ms=29 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEXH0ES8SKGJ91J3Y2W5D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-23T07:13:29.212" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:13:19.213" grpc.time_ms=118.798 pid=923 ref=refs/keep-around/3646acbf947650c454ec92b605947ed1f4893ec6 remote_ip="2001:db8:1::1" revision=3646acbf947650c454ec92b605947ed1f4893ec6 span.kind=server system=grpc username=root1836gitlab # [ 193.333398] gitaly[923]: time="2026-08-23T07:13:19.356Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEXH0ES8SKGJ91J3Y2W5D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:13:49.055" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:13:19.356" grpc.time_ms=0.358 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1837gitlab # [ 193.453159] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:13:19 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3646acbf947650c454ec92b605947ed1f4893ec6 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 5941838gitlab # [ 193.454345] nixbot[2596]: {"ts": "2026-08-23T07:13:19.477Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/3646acbf947650c454ec92b605947ed1f4893ec6 \"HTTP/1.1 201 Created\""}1839gitlab # [ 193.462897] nixbot[2596]: {"ts": "2026-08-23T07:13:19.486Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-3646acbf9476-0"}1840gitlab # [ 193.527737] systemd[1]: Started Nix Daemon.1841gitlab # [ 193.598160] nix-daemon[2805]: accepted connection from pid 2799, user nixbot1842gitlab # [ 193.663556] nix-daemon[2805]: accepted connection from pid 2812, user nixbot1843gitlab # [ 193.678814] nixbot[2596]: {"ts": "2026-08-23T07:13:19.702Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-3646acbf9476-0", "argv0": "bwrap"}1844gitlab # [ 193.825809] nix-daemon[2805]: accepted connection from pid 2822, user nixbot1845gitlab # [ 193.890432] nix-daemon[2805]: accepted connection from pid 2832, user nixbot1846gitlab # [ 193.907800] nix-daemon[2805]: accepted connection from pid 2822, user nixbot1847gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1848gitlab # [ 194.326870] nixbot[2596]: INFO: ::ffff:127.0.0.1:59316 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1849gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.04 seconds)1850gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1851gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.03 seconds)1852gitlab # [ 195.365303] nixbot[2596]: INFO: ::ffff:127.0.0.1:59332 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1853gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1854gitlab # [ 196.399433] nixbot[2596]: INFO: ::ffff:127.0.0.1:59338 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1855gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.04 seconds)1856gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1857gitlab # [ 197.435466] nixbot[2596]: INFO: ::ffff:127.0.0.1:59354 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1858gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.04 seconds)1859gitlab # [ 198.220584] nix-daemon[2805]: accepted connection from pid 2860, user nixbot1860gitlab # [ 198.264754] gitaly[923]: time="2026-08-23T07:13:24.287Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQF2QY84HHXJ8G1A0KHV2W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:13:54.085" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:13:24.286" grpc.time_ms=0.963 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1861gitlab # [ 198.330446] gitaly[923]: time="2026-08-23T07:13:24.353Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0PQF2QY84HHXJ8G1A0KHV2W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:13:34.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:13:24.341" grpc.time_ms=12.378 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1862gitlab # [ 198.415788] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:13:24 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3646acbf947650c454ec92b605947ed1f4893ec6 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 2151863gitlab # [ 198.421312] nixbot[2596]: {"ts": "2026-08-23T07:13:24.440Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/3646acbf947650c454ec92b605947ed1f4893ec6 \"HTTP/1.1 201 Created\""}1864gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1865gitlab # [ 198.472831] nixbot[2596]: INFO: ::ffff:127.0.0.1:59364 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1866gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.04 seconds)1867gitlab # [ 198.491581] gitaly[923]: time="2026-08-23T07:13:24.514Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQF2YXBKNW64TSN8QBSSC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:13:54.113" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:13:24.514" grpc.time_ms=0.651 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1868gitlab # [ 198.560934] gitaly[923]: time="2026-08-23T07:13:24.584Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQF2YXBKNW64TSN8QBSSC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:13:34.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:13:24.575" grpc.time_ms=8.34 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1869gitlab # [ 198.629898] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:13:24 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3646acbf947650c454ec92b605947ed1f4893ec6 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2071870gitlab # [ 198.635445] nixbot[2596]: {"ts": "2026-08-23T07:13:24.653Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/3646acbf947650c454ec92b605947ed1f4893ec6 \"HTTP/1.1 201 Created\""}1871gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1872gitlab # [ 199.509878] nixbot[2596]: INFO: ::ffff:127.0.0.1:59368 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1873gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.04 seconds)1874gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1875gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.03 seconds)1876gitlab # [ 200.546823] nixbot[2596]: INFO: ::ffff:127.0.0.1:59380 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1877gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1878gitlab # [ 201.581354] nixbot[2596]: INFO: ::ffff:127.0.0.1:59392 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1879gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.04 seconds)1880gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1881gitlab # [ 202.618065] nixbot[2596]: INFO: ::ffff:127.0.0.1:59404 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1882gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.04 seconds)1883gitlab # [ 203.136805] nix-daemon[2805]: accepted connection from pid 2904, user nixbot1884gitlab # [ 203.226396] gitaly[923]: time="2026-08-23T07:13:29.249Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQF7K4TZ238JBY8Y6EKKTK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:13:59.047" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:13:29.247" grpc.time_ms=1.021 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1885gitlab # [ 203.265329] gitaly[923]: time="2026-08-23T07:13:29.288Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0PQF7K4TZ238JBY8Y6EKKTK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:13:39.278" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:13:29.279" grpc.time_ms=9.362 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1886gitlab # [ 203.327563] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:13:29 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3646acbf947650c454ec92b605947ed1f4893ec6 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1611887gitlab # [ 203.333136] nixbot[2596]: {"ts": "2026-08-23T07:13:29.350Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/3646acbf947650c454ec92b605947ed1f4893ec6 \"HTTP/1.1 201 Created\""}1888gitlab # [ 203.422370] nix-daemon[2805]: accepted connection from pid 2918, user nixbot1889gitlab # [ 203.524687] gitaly[923]: time="2026-08-23T07:13:29.547Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0PQF7WTRDNHGN2V0YXD95WG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:13:29.536" grpc.time_ms=11.415 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc1890gitlab # [ 203.550668] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:13:29 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 741891gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1892gitlab # [ 203.636852] gitaly[923]: time="2026-08-23T07:13:29.659Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQF7Z8P1JZGE14KW6F6Q4S grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:13:29.647" pid=923 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1893gitlab # [ 203.657090] gitaly[923]: time="2026-08-23T07:13:29.679Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQF7Z8P1JZGE14KW6F6Q4S grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:13:29.647" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc1894gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.06 seconds)1895gitlab # [ 203.676721] nixbot[2596]: INFO: ::ffff:127.0.0.1:41350 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1896gitlab # [ 203.681666] gitaly[923]: time="2026-08-23T07:13:29.704Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQF7Z8P1JZGE14KW6F6Q4S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:13:29.647" grpc.time_ms=32.682 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc1897gitlab # [ 203.682430] gitlab-workhorse[825]: time="2026-08-23T07:13:29Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671898gitlab # [ 203.682941] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:13:29 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1281899gitlab # [ 203.771085] nix-daemon[2805]: accepted connection from pid 2946, user nixbot1900gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1901gitlab # [ 204.712413] nixbot[2596]: INFO: ::ffff:127.0.0.1:41352 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1902gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.04 seconds)1903gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1904gitlab # [ 205.747701] nixbot[2596]: INFO: ::ffff:127.0.0.1:41364 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1905gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.03 seconds)1906gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1907gitlab # [ 206.783381] nixbot[2596]: INFO: ::ffff:127.0.0.1:41380 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1908gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.04 seconds)1909gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1910gitlab # [ 207.821447] nixbot[2596]: INFO: ::ffff:127.0.0.1:41388 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1911gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.04 seconds)1912gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1913gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.03 seconds)1914gitlab # [ 208.857900] nixbot[2596]: INFO: ::ffff:127.0.0.1:41402 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1915gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1916gitlab # [ 209.891404] nixbot[2596]: INFO: ::ffff:127.0.0.1:41408 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1917gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.04 seconds)1918gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1919gitlab # [ 210.927847] nixbot[2596]: INFO: ::ffff:127.0.0.1:41412 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1920gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.03 seconds)1921gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1922gitlab # [ 211.963738] nixbot[2596]: INFO: ::ffff:127.0.0.1:41424 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1923gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.04 seconds)1924gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1925gitlab # [ 212.999660] nixbot[2596]: INFO: ::ffff:127.0.0.1:55968 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1926gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.04 seconds)1927gitlab # [ 213.220936] sidekiq-cluster[2577]: 2026-08-23T07:13:39.243Z pid=2577 tid=xbt INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2577, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>434069504}1928gitlab # [ 213.388624] sidekiq-cluster[2577]: W, [2026-08-23T07:13:39.411734 #2577] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1929gitlab # [ 213.425697] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:13:39.448Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1930gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1931gitlab # [ 214.036337] nixbot[2596]: INFO: ::ffff:127.0.0.1:55980 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1932gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.03 seconds)1933gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1934gitlab # [ 215.071254] nixbot[2596]: INFO: ::ffff:127.0.0.1:55990 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1935gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.04 seconds)1936gitlab # [ 215.101864] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:13:41.124Z","message":"GitLab reliable fetch activated!"}1937gitlab # [ 215.105381] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:13:41.124Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1938gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1939gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.03 seconds)1940gitlab # [ 216.104224] nixbot[2596]: INFO: ::ffff:127.0.0.1:55996 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1941gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1942gitlab # [ 217.137481] nixbot[2596]: INFO: ::ffff:127.0.0.1:56004 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1943gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.04 seconds)1944gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1945gitlab # [ 218.175182] nixbot[2596]: INFO: ::ffff:127.0.0.1:56006 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1946gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.04 seconds)1947gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1948gitlab # [ 219.211444] nixbot[2596]: INFO: ::ffff:127.0.0.1:56022 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1949gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.04 seconds)1950gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1951gitlab # [ 220.247402] nixbot[2596]: INFO: ::ffff:127.0.0.1:56030 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1952gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.04 seconds)1953gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1954gitlab # [ 221.284836] nixbot[2596]: INFO: ::ffff:127.0.0.1:56038 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1955gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.04 seconds)1956gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1957gitlab # [ 222.322446] nixbot[2596]: INFO: ::ffff:127.0.0.1:56042 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1958gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.03 seconds)1959gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1960gitlab # [ 223.358105] nixbot[2596]: INFO: ::ffff:127.0.0.1:55832 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1961gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.04 seconds)1962gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1963gitlab # [ 224.395909] nixbot[2596]: INFO: ::ffff:127.0.0.1:55842 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1964gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.03 seconds)1965gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1966gitlab # [ 225.431447] nixbot[2596]: INFO: ::ffff:127.0.0.1:55854 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1967gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.03 seconds)1968gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1969gitlab # [ 226.466477] nixbot[2596]: INFO: ::ffff:127.0.0.1:55862 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1970gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.04 seconds)1971gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1972gitlab # [ 227.504528] nixbot[2596]: INFO: ::ffff:127.0.0.1:55876 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1973gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.04 seconds)1974gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1975gitlab # [ 228.542058] nixbot[2596]: INFO: ::ffff:127.0.0.1:55890 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1976gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.04 seconds)1977gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1978gitlab # [ 229.579639] nixbot[2596]: INFO: ::ffff:127.0.0.1:55896 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1979gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.04 seconds)1980gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1981gitlab # [ 230.616980] nixbot[2596]: INFO: ::ffff:127.0.0.1:55910 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1982gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.04 seconds)1983gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1984gitlab # [ 231.655439] nixbot[2596]: INFO: ::ffff:127.0.0.1:55914 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1985gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.04 seconds)1986gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1987gitlab # [ 232.683911] nixbot[2596]: INFO: ::ffff:127.0.0.1:55920 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1988gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.03 seconds)1989gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1990gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.03 seconds)1991gitlab # [ 233.721629] nixbot[2596]: INFO: ::ffff:127.0.0.1:36140 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1992gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1993gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.03 seconds)1994gitlab # [ 234.754723] nixbot[2596]: INFO: ::ffff:127.0.0.1:36148 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1995gitlab # [ 234.768655] postgres[3056]: [3056] ERROR: relation "table_without_models" does not exist1996gitlab # [ 234.769992] postgres[3056]: [3056] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1997gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'1998gitlab # [ 235.788568] nixbot[2596]: INFO: ::ffff:127.0.0.1:36154 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK1999gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.04 seconds)2000gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'2001gitlab # [ 236.826587] nixbot[2596]: INFO: ::ffff:127.0.0.1:36166 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK2002gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.04 seconds)2003gitlab # [ 237.158094] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:03.180Z","message":"Booted Rails 7.2.3.1 application in production environment"}2004gitlab # [ 237.162227] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:03.185Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}2005gitlab # [ 237.166104] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:03.185Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}2006gitlab # [ 237.169661] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:03.189Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}2007gitlab # [ 237.175260] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:03.198Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2008gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'2009gitlab # [ 237.863745] nixbot[2596]: INFO: ::ffff:127.0.0.1:36182 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK2010gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.03 seconds)2011gitlab # [ 238.516537] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:04.538Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"321071da419b0996a0760655","created_at":"2026-08-23T07:13:12.483Z","trace_propagation_headers":{"sentry-trace":"be8cf7e7b9284324adf32473e22e5e59-a46622178d044f06","baggage":"sentry-trace_id=be8cf7e7b9284324adf32473e22e5e59,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQEPGPTZQ1WGDDY4FNADY9","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:12.507Z","job_size_bytes":2,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-321071da419b0996a0760655: start","job_status":"start","queue_duration_s":52.031337,"scheduling_latency_s":52.031371}2012gitlab # [ 238.701805] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:04.724Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"321071da419b0996a0760655","created_at":"2026-08-23T07:13:12.483Z","trace_propagation_headers":{"sentry-trace":"be8cf7e7b9284324adf32473e22e5e59-a46622178d044f06","baggage":"sentry-trace_id=be8cf7e7b9284324adf32473e22e5e59,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQEPGPTZQ1WGDDY4FNADY9","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:12.507Z","job_size_bytes":2,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-321071da419b0996a0760655: done: 0.185876 sec","job_status":"done","queue_duration_s":52.031337,"scheduling_latency_s":52.031371,"redis_calls":25,"redis_duration_s":0.007426,"redis_read_bytes":912,"redis_write_bytes":2805,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.00445,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001536,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00144,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":11,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.094296,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.090368468,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.185876,"completed_at":"2026-08-23T07:14:04.724Z","load_balancing_strategy":"primary","db_duration_s":0.04797,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2013gitlab # [ 238.704214] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:04.726Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"820f51288d9bb5ebb9eaaa5d","created_at":"2026-08-23T07:13:12.514Z","trace_propagation_headers":{"sentry-trace":"be8cf7e7b9284324adf32473e22e5e59-a46622178d044f06","baggage":"sentry-trace_id=be8cf7e7b9284324adf32473e22e5e59,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQEPGPTZQ1WGDDY4FNADY9","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:12.518Z","job_size_bytes":2,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-820f51288d9bb5ebb9eaaa5d: start","job_status":"start","queue_duration_s":52.207619,"scheduling_latency_s":52.207634}2014gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'2015gitlab # [ 238.819672] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:04.842Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"820f51288d9bb5ebb9eaaa5d","created_at":"2026-08-23T07:13:12.514Z","trace_propagation_headers":{"sentry-trace":"be8cf7e7b9284324adf32473e22e5e59-a46622178d044f06","baggage":"sentry-trace_id=be8cf7e7b9284324adf32473e22e5e59,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQEPGPTZQ1WGDDY4FNADY9","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:12.518Z","job_size_bytes":2,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-820f51288d9bb5ebb9eaaa5d: done: 0.115877 sec","job_status":"done","queue_duration_s":52.207619,"scheduling_latency_s":52.207634,"redis_calls":14,"redis_duration_s":0.004041,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000824,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001996,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001221,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.080557,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0860953,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.115877,"completed_at":"2026-08-23T07:14:04.842Z","load_balancing_strategy":"primary","db_duration_s":0.025562,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2016gitlab # [ 238.821709] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:04.844Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"2d086009876988a2e864569d","created_at":"2026-08-23T07:13:13.000Z","trace_propagation_headers":{"sentry-trace":"be8cf7e7b9284324adf32473e22e5e59-a46622178d044f06","baggage":"sentry-trace_id=be8cf7e7b9284324adf32473e22e5e59,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQEPGPTZQ1WGDDY4FNADY9","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:13.005Z","job_size_bytes":5,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-2d086009876988a2e864569d: start","job_status":"start","queue_duration_s":51.839088,"scheduling_latency_s":51.839121}2017gitlab # [ 238.898858] nixbot[2596]: INFO: ::ffff:127.0.0.1:36186 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK2018gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.04 seconds)2019gitlab # [ 238.979243] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:05.002Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"2d086009876988a2e864569d","created_at":"2026-08-23T07:13:13.000Z","trace_propagation_headers":{"sentry-trace":"be8cf7e7b9284324adf32473e22e5e59-a46622178d044f06","baggage":"sentry-trace_id=be8cf7e7b9284324adf32473e22e5e59,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQEPGPTZQ1WGDDY4FNADY9","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:13.005Z","job_size_bytes":5,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-2d086009876988a2e864569d: done: 0.157921 sec","job_status":"done","queue_duration_s":51.839088,"scheduling_latency_s":51.839121,"redis_calls":12,"redis_duration_s":0.002989,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00085,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001721,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000418,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.124129,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000306184,"duration_s":0.157921,"completed_at":"2026-08-23T07:14:05.002Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.020522,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2020gitlab # [ 238.981631] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:05.003Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"d03795f016283b35fa300fee","created_at":"2026-08-23T07:13:13.026Z","trace_propagation_headers":{"sentry-trace":"be8cf7e7b9284324adf32473e22e5e59-a46622178d044f06","baggage":"sentry-trace_id=be8cf7e7b9284324adf32473e22e5e59,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQEPGPTZQ1WGDDY4FNADY9","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:13.029Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-d03795f016283b35fa300fee: start","job_status":"start","queue_duration_s":51.973989,"scheduling_latency_s":51.974003}2021gitlab # [ 239.130112] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:05.153Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"d03795f016283b35fa300fee","created_at":"2026-08-23T07:13:13.026Z","trace_propagation_headers":{"sentry-trace":"be8cf7e7b9284324adf32473e22e5e59-a46622178d044f06","baggage":"sentry-trace_id=be8cf7e7b9284324adf32473e22e5e59,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQEPGPTZQ1WGDDY4FNADY9","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:13.029Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-d03795f016283b35fa300fee: done: 0.149463 sec","job_status":"done","queue_duration_s":51.973989,"scheduling_latency_s":51.974003,"redis_calls":11,"redis_duration_s":0.002502,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00067,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001366,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000466,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.125,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.125,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.079201,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000403962,"duration_s":0.149463,"completed_at":"2026-08-23T07:14:05.153Z","load_balancing_strategy":"primary","db_duration_s":0.06971,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2022gitlab # [ 239.133171] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:05.154Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"eeb5f2c2dc606648afa6cb63","created_at":"2026-08-23T07:13:13.031Z","trace_propagation_headers":{"sentry-trace":"be8cf7e7b9284324adf32473e22e5e59-a46622178d044f06","baggage":"sentry-trace_id=be8cf7e7b9284324adf32473e22e5e59,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQEPGPTZQ1WGDDY4FNADY9","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:13.034Z","job_size_bytes":89,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-eeb5f2c2dc606648afa6cb63: start","job_status":"start","queue_duration_s":52.119843,"scheduling_latency_s":52.119856}2023gitlab # [ 239.246539] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:05.269Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"eeb5f2c2dc606648afa6cb63","created_at":"2026-08-23T07:13:13.031Z","trace_propagation_headers":{"sentry-trace":"be8cf7e7b9284324adf32473e22e5e59-a46622178d044f06","baggage":"sentry-trace_id=be8cf7e7b9284324adf32473e22e5e59,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQEPGPTZQ1WGDDY4FNADY9","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:13.034Z","job_size_bytes":89,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-eeb5f2c2dc606648afa6cb63: done: 0.11453 sec","job_status":"done","queue_duration_s":52.119843,"scheduling_latency_s":52.119856,"redis_calls":11,"redis_duration_s":0.075138,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.07353,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00116,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000448,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02814,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000441117,"duration_s":0.11453,"completed_at":"2026-08-23T07:14:05.268Z","load_balancing_strategy":"primary","db_duration_s":0.006507,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2024gitlab # [ 239.293295] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:05.316Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 3646acbf947650c454ec92b605947ed1f4893ec6 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"9b245b18e864b4730b6caad2","created_at":"2026-08-23T07:13:14.655Z","trace_propagation_headers":{"sentry-trace":"dff9013c1bde4a7d87809bf40878def6-b2ba88ff5fea4cf8","baggage":"sentry-trace_id=dff9013c1bde4a7d87809bf40878def6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQERPD61XC06C394QS1VT8","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:14.673Z","job_size_bytes":185,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-9b245b18e864b4730b6caad2: start","job_status":"start","queue_duration_s":50.642275,"scheduling_latency_s":50.642311}2025gitlab # [ 239.329466] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:05.352Z","message":"changes: \"0000000000000000000000000000000000000000 3646acbf947650c454ec92b605947ed1f4893ec6 refs/heads/master\\n\""}2026gitlab # [ 239.379268] gitaly[923]: time="2026-08-23T07:14:05.401Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQERPD61XC06C394QS1VT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:14:15.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:14:05.390" grpc.time_ms=10.886 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2027gitlab # [ 239.416928] gitaly[923]: time="2026-08-23T07:14:05.440Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQERPD61XC06C394QS1VT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-23T07:14:15.049" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:14:05.429" grpc.time_ms=9.981 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2028gitlab # [ 239.484144] gitaly[923]: time="2026-08-23T07:14:05.507Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0PQERPD61XC06C394QS1VT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-23T07:14:15.113" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:14:05.494" grpc.time_ms=13.194 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2029gitlab # [ 239.563900] gitaly[923]: time="2026-08-23T07:14:05.587Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQERPD61XC06C394QS1VT8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3929 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:14:05.586" grpc.time_ms=0.621 pid=923 span.kind=server system=grpc2030gitlab # [ 239.622666] gitaly[923]: time="2026-08-23T07:14:05.645Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQERPD61XC06C394QS1VT8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3931 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:14:05.644" grpc.time_ms=0.51 pid=923 span.kind=server system=grpc2031gitlab # [ 239.643707] gitaly[923]: time="2026-08-23T07:14:05.666Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQERPD61XC06C394QS1VT8 diskcache=f078a8a2-f4c7-43df-8afd-1e8354ac75e8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-23T07:14:15.163" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:14:05.543" pid=923 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2032gitlab # [ 239.652242] gitaly[923]: time="2026-08-23T07:14:05.667Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=112 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5097 command.oublock=8 command.real_time_ms=116 command.spawn_token_fork_ms=0 command.system_time_ms=72 command.user_time_ms=40 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQERPD61XC06C394QS1VT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-23T07:14:15.163" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:14:05.543" grpc.time_ms=123.065 pid=923 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2033gitlab # [ 239.663821] gitaly[923]: time="2026-08-23T07:14:05.687Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQERPD61XC06C394QS1VT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T07:14:15.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:14:05.686" grpc.time_ms=0.173 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2034gitlab # [ 239.687416] gitaly[923]: time="2026-08-23T07:14:05.710Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=939 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQERPD61XC06C394QS1VT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-23T07:14:15.019" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:14:05.700" grpc.time_ms=10.38 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2035gitlab # [ 239.769262] gitaly[923]: time="2026-08-23T07:14:05.792Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=339 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQERPD61XC06C394QS1VT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-23T07:14:35.087" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:14:05.788" grpc.time_ms=4.387 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2036gitlab # [ 239.790774] gitaly[923]: time="2026-08-23T07:14:05.814Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQERPD61XC06C394QS1VT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-23T07:14:15.133" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:14:05.813" grpc.time_ms=0.173 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2037gitlab # [ 239.800670] gitaly[923]: time="2026-08-23T07:14:05.823Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=340 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQERPD61XC06C394QS1VT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-23T07:14:15.136" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-23T07:14:05.816" grpc.time_ms=7.352 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2038gitlab # [ 239.819977] gitaly[923]: time="2026-08-23T07:14:05.843Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0PQERPD61XC06C394QS1VT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:14:15.151" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:14:05.832" grpc.time_ms=10.781 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2039gitlab # [ 239.831979] gitaly[923]: time="2026-08-23T07:14:05.855Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQERPD61XC06C394QS1VT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:14:15.166" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:14:05.847" grpc.time_ms=7.79 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2040gitlab # [ 239.860674] gitaly[923]: time="2026-08-23T07:14:05.883Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=967 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQERPD61XC06C394QS1VT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-23T07:14:35.170" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:14:05.870" grpc.time_ms=13.41 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2041gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'2042gitlab # [ 239.941489] nixbot[2596]: INFO: ::ffff:127.0.0.1:36202 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK2043gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.04 seconds)2044gitlab # [ 240.227439] gitaly[923]: time="2026-08-23T07:14:06.250Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQERPD61XC06C394QS1VT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-23T07:14:16.008" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:14:06.249" grpc.time_ms=1.137 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2045gitlab # [ 240.298457] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:06.320Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 3646acbf947650c454ec92b605947ed1f4893ec6 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"9b245b18e864b4730b6caad2","created_at":"2026-08-23T07:13:14.655Z","trace_propagation_headers":{"sentry-trace":"dff9013c1bde4a7d87809bf40878def6-b2ba88ff5fea4cf8","baggage":"sentry-trace_id=dff9013c1bde4a7d87809bf40878def6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQERPD61XC06C394QS1VT8","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:14.673Z","job_size_bytes":185,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-9b245b18e864b4730b6caad2: done: 1.004384 sec","job_status":"done","queue_duration_s":50.642275,"scheduling_latency_s":50.642311,"gitaly_calls":13,"gitaly_duration_s":0.263011,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.125144,"redis_read_bytes":2103,"redis_write_bytes":21751,"redis_cache_calls":15,"redis_cache_duration_s":0.004016,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.006407,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001675,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7839,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003372,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.073119,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.036555,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.054,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.159,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.181,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.054,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.537263,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000709029,"exclusive_lock_hold_duration_s":0.056871753,"duration_s":1.004384,"completed_at":"2026-08-23T07:14:06.320Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.094147,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2046gitlab # [ 240.370781] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:06.322Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","3646acbf947650c454ec92b605947ed1f4893ec6 980b228ea51cf3fdbab6e682314494429da25dba refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"b77a32765b8f6eb5bf0e334e","created_at":"2026-08-23T07:13:18.119Z","trace_propagation_headers":{"sentry-trace":"855e2517071340329548f6b061d6a875-9f05c1ebc3a6443a","baggage":"sentry-trace_id=855e2517071340329548f6b061d6a875,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQEWDY51YW9A7KXEFMDKX9","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:18.121Z","job_size_bytes":185,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-b77a32765b8f6eb5bf0e334e: start","job_status":"start","queue_duration_s":48.200827,"scheduling_latency_s":48.200854}2047gitlab # [ 240.371557] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:06.336Z","message":"changes: \"3646acbf947650c454ec92b605947ed1f4893ec6 980b228ea51cf3fdbab6e682314494429da25dba refs/heads/master\\n\""}2048gitlab # [ 240.371956] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:06.380Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"47ab178b8c62949719e2b0c4","created_at":"2026-08-23T07:14:06.377Z","trace_propagation_headers":{"sentry-trace":"855e2517071340329548f6b061d6a875-5b118984e34a463a","baggage":"sentry-trace_id=855e2517071340329548f6b061d6a875,sentry-release=Unknown"},"correlation_id":"01M0PQEWDY51YW9A7KXEFMDKX9","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"72867992dff090a9baddac49","job_size_bytes":46,"pid":2577,"job_status":"deduplicated","message":"ProjectCacheWorker JID-47ab178b8c62949719e2b0c4: deduplicated: until executing","deduplication.type":"until executing"}2049gitlab # [ 240.372539] gitaly[923]: time="2026-08-23T07:14:06.362Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQEWDY51YW9A7KXEFMDKX9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:14:16.110" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:14:06.351" grpc.time_ms=10.778 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2050gitlab # [ 240.376572] gitaly[923]: time="2026-08-23T07:14:06.375Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEWDY51YW9A7KXEFMDKX9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-23T07:14:16.125" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:14:06.365" grpc.time_ms=9.654 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2051gitlab # [ 240.418132] gitaly[923]: time="2026-08-23T07:14:06.409Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M0PQEWDY51YW9A7KXEFMDKX9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-23T07:14:16.016" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:14:06.397" grpc.time_ms=11.601 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2052gitlab # [ 240.418806] gitaly[923]: time="2026-08-23T07:14:06.424Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=657 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQEWDY51YW9A7KXEFMDKX9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-23T07:14:36.013" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:14:06.413" grpc.time_ms=10.945 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2053gitlab # [ 240.419648] gitaly[923]: time="2026-08-23T07:14:06.439Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=344 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQEWDY51YW9A7KXEFMDKX9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-23T07:14:16.053" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-23T07:14:06.433" grpc.time_ms=5.743 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2054gitlab # [ 240.432967] gitaly[923]: time="2026-08-23T07:14:06.456Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQEWDY51YW9A7KXEFMDKX9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:14:16.065" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:14:06.445" grpc.time_ms=10.747 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2055gitlab # [ 240.495748] gitaly[923]: time="2026-08-23T07:14:06.518Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQEWDY51YW9A7KXEFMDKX9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-23T07:14:16.137" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:14:06.517" grpc.time_ms=0.961 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2056gitlab # [ 240.510071] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:06.532Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","3646acbf947650c454ec92b605947ed1f4893ec6 980b228ea51cf3fdbab6e682314494429da25dba refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"b77a32765b8f6eb5bf0e334e","created_at":"2026-08-23T07:13:18.119Z","trace_propagation_headers":{"sentry-trace":"855e2517071340329548f6b061d6a875-9f05c1ebc3a6443a","baggage":"sentry-trace_id=855e2517071340329548f6b061d6a875,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQEWDY51YW9A7KXEFMDKX9","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:13:18.121Z","job_size_bytes":185,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-b77a32765b8f6eb5bf0e334e: done: 0.210569 sec","job_status":"done","queue_duration_s":48.200827,"scheduling_latency_s":48.200854,"gitaly_calls":7,"gitaly_duration_s":0.075153,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.020689,"redis_read_bytes":500,"redis_write_bytes":11942,"redis_cache_calls":9,"redis_cache_duration_s":0.002773,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001329,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5719,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.00464,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.006984,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.004963,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.016,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.016,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.102592,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000460673,"exclusive_lock_hold_duration_s":0.018290593,"duration_s":0.210569,"completed_at":"2026-08-23T07:14:06.532Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023032,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2057gitlab # [ 240.530938] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:06.534Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"ca77dbe4bb3c7a5e46e5ece7","created_at":"2026-08-23T07:13:19.371Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-f007f2442a104fd4","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:19.376Z","job_size_bytes":65,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-ca77dbe4bb3c7a5e46e5ece7: start","job_status":"start","queue_duration_s":47.157692,"scheduling_latency_s":47.157709}2058gitlab # [ 240.573120] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:06.596Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"ca77dbe4bb3c7a5e46e5ece7","created_at":"2026-08-23T07:13:19.371Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-f007f2442a104fd4","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:19.376Z","job_size_bytes":65,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-ca77dbe4bb3c7a5e46e5ece7: done: 0.061381 sec","job_status":"done","queue_duration_s":47.157692,"scheduling_latency_s":47.157709,"redis_calls":16,"redis_duration_s":0.003941,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002256,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001236,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000449,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03436,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000287746,"duration_s":0.061381,"completed_at":"2026-08-23T07:14:06.596Z","load_balancing_strategy":"primary","db_duration_s":0.020496,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2059gitlab # [ 240.574711] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:06.597Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"68d9c4c9c3795c9fb20cdc17","created_at":"2026-08-23T07:13:19.377Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-f007f2442a104fd4","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:19.380Z","job_size_bytes":65,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-68d9c4c9c3795c9fb20cdc17: start","job_status":"start","queue_duration_s":47.216843,"scheduling_latency_s":47.216856}2060gitlab # [ 240.714310] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:06.737Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"68d9c4c9c3795c9fb20cdc17","created_at":"2026-08-23T07:13:19.377Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-f007f2442a104fd4","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:19.380Z","job_size_bytes":65,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-68d9c4c9c3795c9fb20cdc17: done: 0.13985 sec","job_status":"done","queue_duration_s":47.216843,"scheduling_latency_s":47.216856,"redis_calls":21,"redis_duration_s":0.006019,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.003008,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001592,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001419,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.073,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.066,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055201,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000866312,"duration_s":0.13985,"completed_at":"2026-08-23T07:14:06.737Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.077507,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2061gitlab # [ 240.718132] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:06.738Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"9905a136088881a98211fd06","created_at":"2026-08-23T07:13:19.460Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-f007f2442a104fd4","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:19.464Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-9905a136088881a98211fd06: start","job_status":"start","queue_duration_s":47.274444,"scheduling_latency_s":47.274461}2062gitlab # [ 240.851704] gitaly[923]: time="2026-08-23T07:14:06.874Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQEXH0ES8SKGJ91J3Y2W5D grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3890 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:14:06.873" grpc.time_ms=1.003 pid=923 span.kind=server system=grpc2063gitlab # [ 240.891460] gitaly[923]: time="2026-08-23T07:14:06.914Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQEXH0ES8SKGJ91J3Y2W5D grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3888 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:14:06.914" grpc.time_ms=0.429 pid=923 span.kind=server system=grpc2064gitlab # [ 240.916774] gitaly[923]: time="2026-08-23T07:14:06.940Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQEXH0ES8SKGJ91J3Y2W5D grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3890 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:14:06.939" grpc.time_ms=0.312 pid=923 span.kind=server system=grpc2065gitlab # [ 240.933030] gitaly[923]: time="2026-08-23T07:14:06.956Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEXH0ES8SKGJ91J3Y2W5D diskcache=4f5ed4ce-7fc8-48b5-ab66-c45116f1a7a2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T07:14:36.133" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:14:06.834" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2066gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'2067gitlab # [ 240.933694] gitaly[923]: time="2026-08-23T07:14:06.956Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=112 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7677 command.oublock=0 command.real_time_ms=113 command.spawn_token_fork_ms=0 command.system_time_ms=64 command.user_time_ms=48 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEXH0ES8SKGJ91J3Y2W5D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T07:14:36.133" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:14:06.834" grpc.time_ms=122.233 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2068gitlab # [ 240.969699] nixbot[2596]: INFO: ::ffff:127.0.0.1:36204 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK2069gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.03 seconds)2070gitlab # [ 241.013241] gitaly[923]: time="2026-08-23T07:14:07.036Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQEXH0ES8SKGJ91J3Y2W5D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-23T07:14:37.034" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:14:07.035" grpc.time_ms=1.172 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2071gitlab # [ 241.073529] gitaly[923]: time="2026-08-23T07:14:07.096Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEXH0ES8SKGJ91J3Y2W5D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:14:37.094" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:14:07.095" grpc.time_ms=0.856 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2072gitlab # [ 241.114258] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:07.137Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"9905a136088881a98211fd06","created_at":"2026-08-23T07:13:19.460Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-f007f2442a104fd4","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:19.464Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2577,"job_status":"rescheduled","message":"PipelineProcessWorker JID-9905a136088881a98211fd06: rescheduled"}2073gitlab # [ 241.124527] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:07.147Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"9905a136088881a98211fd06","created_at":"2026-08-23T07:13:19.460Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-f007f2442a104fd4","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-23T07:13:19.464Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-9905a136088881a98211fd06: done: 0.408735 sec","job_status":"done","queue_duration_s":47.274444,"scheduling_latency_s":47.274461,"gitaly_calls":3,"gitaly_duration_s":0.158836,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.021935,"redis_read_bytes":462,"redis_write_bytes":29297,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001022,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001461,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.007259,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.003143,"redis_queues_read_bytes":39,"redis_queues_write_bytes":15584,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.0049,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000597,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000389,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002142,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.064,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.017,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.021,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.038,"db_ci_duration_s":0.026,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.163886,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.358801188,"duration_s":0.408735,"completed_at":"2026-08-23T07:14:07.147Z","load_balancing_strategy":"primary","db_duration_s":0.074257,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2074gitlab # [ 241.177210] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:07.149Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"72867992dff090a9baddac49","created_at":"2026-08-23T07:14:05.443Z","trace_propagation_headers":{"sentry-trace":"dff9013c1bde4a7d87809bf40878def6-9c85a3fe9d024239","baggage":"sentry-trace_id=dff9013c1bde4a7d87809bf40878def6,sentry-release=Unknown"},"correlation_id":"01M0PQERPD61XC06C394QS1VT8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:05.466Z","job_size_bytes":46,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-72867992dff090a9baddac49: start","job_status":"start","queue_duration_s":1.682643,"scheduling_latency_s":1.682713}2075gitlab # [ 241.178218] gitaly[923]: time="2026-08-23T07:14:07.187Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQERPD61XC06C394QS1VT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-23T13:14:07.181" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:14:07.182" grpc.time_ms=4.88 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2076gitlab # [ 241.228534] gitaly[923]: time="2026-08-23T07:14:07.251Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=654 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQERPD61XC06C394QS1VT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-23T07:14:37.240" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:14:07.241" grpc.time_ms=10.318 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2077gitlab # [ 241.256935] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:07.279Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"72867992dff090a9baddac49","created_at":"2026-08-23T07:14:05.443Z","trace_propagation_headers":{"sentry-trace":"dff9013c1bde4a7d87809bf40878def6-9c85a3fe9d024239","baggage":"sentry-trace_id=dff9013c1bde4a7d87809bf40878def6,sentry-release=Unknown"},"correlation_id":"01M0PQERPD61XC06C394QS1VT8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:05.466Z","job_size_bytes":46,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-72867992dff090a9baddac49: done: 0.130491 sec","job_status":"done","queue_duration_s":1.682643,"scheduling_latency_s":1.682713,"gitaly_calls":2,"gitaly_duration_s":0.066978,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.007156,"redis_read_bytes":69,"redis_write_bytes":4886,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001453,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.00066,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2114,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.0016,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.002711,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000732,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041964,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000375188,"duration_s":0.130491,"completed_at":"2026-08-23T07:14:07.279Z","load_balancing_strategy":"primary","db_duration_s":0.012871,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2078gitlab # [ 241.260582] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:07.281Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"27148a65639d0480332be850","created_at":"2026-08-23T07:14:05.483Z","trace_propagation_headers":{"sentry-trace":"dff9013c1bde4a7d87809bf40878def6-9c85a3fe9d024239","baggage":"sentry-trace_id=dff9013c1bde4a7d87809bf40878def6,sentry-release=Unknown"},"correlation_id":"01M0PQERPD61XC06C394QS1VT8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:05.489Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-27148a65639d0480332be850: start","job_status":"start","queue_duration_s":1.792244,"scheduling_latency_s":1.792259}2079gitlab # [ 241.305634] gitaly[923]: time="2026-08-23T07:14:07.321Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQERPD61XC06C394QS1VT8 diskcache=5cff8049-2315-4c74-9ea1-a6c9fbae88d0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-23T13:14:07.297" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:14:07.297" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2080gitlab # [ 241.306520] gitaly[923]: time="2026-08-23T07:14:07.322Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1286 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQERPD61XC06C394QS1VT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-23T13:14:07.297" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:14:07.297" grpc.time_ms=24.288 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2081gitlab # [ 241.337087] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:07.359Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"27148a65639d0480332be850","created_at":"2026-08-23T07:14:05.483Z","trace_propagation_headers":{"sentry-trace":"dff9013c1bde4a7d87809bf40878def6-9c85a3fe9d024239","baggage":"sentry-trace_id=dff9013c1bde4a7d87809bf40878def6,sentry-release=Unknown"},"correlation_id":"01M0PQERPD61XC06C394QS1VT8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:05.489Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-27148a65639d0480332be850: done: 0.078138 sec","job_status":"done","queue_duration_s":1.792244,"scheduling_latency_s":1.792259,"gitaly_calls":1,"gitaly_duration_s":0.026407,"redis_calls":15,"redis_duration_s":0.003405,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000427,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001211,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000612,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001155,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.01,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.02,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035741,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.061137379,"duration_s":0.078138,"completed_at":"2026-08-23T07:14:07.359Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012531,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2082gitlab # [ 241.339271] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:07.360Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"ce43b66553df6334eb7f342e","created_at":"2026-08-23T07:14:05.680Z","trace_propagation_headers":{"sentry-trace":"dff9013c1bde4a7d87809bf40878def6-9c85a3fe9d024239","baggage":"sentry-trace_id=dff9013c1bde4a7d87809bf40878def6,sentry-release=Unknown"},"correlation_id":"01M0PQERPD61XC06C394QS1VT8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:05.682Z","job_size_bytes":23,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-ce43b66553df6334eb7f342e: start","job_status":"start","queue_duration_s":1.678227,"scheduling_latency_s":1.678242}2083gitlab # [ 241.408190] gitaly[923]: time="2026-08-23T07:14:07.431Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=656 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQERPD61XC06C394QS1VT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-23T07:14:37.420" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:14:07.421" grpc.time_ms=9.787 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2084gitlab # [ 241.414888] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:07.437Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"ce43b66553df6334eb7f342e","created_at":"2026-08-23T07:14:05.680Z","trace_propagation_headers":{"sentry-trace":"dff9013c1bde4a7d87809bf40878def6-9c85a3fe9d024239","baggage":"sentry-trace_id=dff9013c1bde4a7d87809bf40878def6,sentry-release=Unknown"},"correlation_id":"01M0PQERPD61XC06C394QS1VT8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:05.682Z","job_size_bytes":23,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-ce43b66553df6334eb7f342e: done: 0.077168 sec","job_status":"done","queue_duration_s":1.678227,"scheduling_latency_s":1.678242,"gitaly_calls":1,"gitaly_duration_s":0.011765,"redis_calls":16,"redis_duration_s":0.003513,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000289,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000989,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.001606,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000629,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.043,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.043,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01818,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.077168,"completed_at":"2026-08-23T07:14:07.437Z","load_balancing_strategy":"primary","db_duration_s":0.04305,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2085gitlab # [ 241.419821] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:07.439Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"5e064c34d21e799769dba067","created_at":"2026-08-23T07:14:06.078Z","trace_propagation_headers":{"sentry-trace":"dff9013c1bde4a7d87809bf40878def6-9c85a3fe9d024239","baggage":"sentry-trace_id=dff9013c1bde4a7d87809bf40878def6,sentry-release=Unknown"},"correlation_id":"01M0PQERPD61XC06C394QS1VT8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63ad72aca05100ff21bae62e89dc62b71f6bb5d828b500d5c7f8cf7202d04ebb","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:06.081Z","job_size_bytes":467,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-5e064c34d21e799769dba067: start","job_status":"start","queue_duration_s":1.357564,"scheduling_latency_s":1.357581}2086gitlab # [ 241.435790] gitaly[923]: time="2026-08-23T07:14:07.458Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQERPD61XC06C394QS1VT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:14:37.456" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:14:07.457" grpc.time_ms=0.959 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2087gitlab # [ 241.446145] gitaly[923]: time="2026-08-23T07:14:07.469Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQERPD61XC06C394QS1VT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-23T07:14:17.221" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:14:07.461" grpc.time_ms=7.36 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2088gitlab # [ 241.524395] gitaly[923]: time="2026-08-23T07:14:07.547Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQERPD61XC06C394QS1VT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-23T07:14:37.546" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:14:07.546" grpc.time_ms=0.843 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2089gitlab # [ 241.537665] gitaly[923]: time="2026-08-23T07:14:07.560Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=38 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQERPD61XC06C394QS1VT8 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-23T07:14:37.558" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:14:07.558" grpc.time_ms=2.239 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2090gitlab # [ 241.636859] gitaly[923]: time="2026-08-23T07:14:07.660Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQERPD61XC06C394QS1VT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:14:17.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:14:07.649" grpc.time_ms=10.745 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2091gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'2092gitlab # [ 242.011336] nixbot[2596]: INFO: ::ffff:127.0.0.1:36216 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK2093gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.04 seconds)2094gitlab # [ 242.097085] gitaly[923]: time="2026-08-23T07:14:08.120Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=962 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQERPD61XC06C394QS1VT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-23T07:14:38.103" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:14:08.103" grpc.time_ms=16.702 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2095gitlab # [ 242.144745] gitaly[923]: time="2026-08-23T07:14:08.167Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQERPD61XC06C394QS1VT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-23T07:14:38.152" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:14:08.152" grpc.time_ms=15.284 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2096gitlab # [ 242.180077] sidekiq-cluster[2577]: {"severity":"WARN","time":"2026-08-23T07:14:08.203Z","class":"CreatePipelineWorker","correlation_id":"01M0PQERPD61XC06C394QS1VT8","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"3646acbf947650c454ec92b605947ed1f4893ec6","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"3646acbf947650c454ec92b605947ed1f4893ec6","ref":"refs/heads/master"},"retry":0}2097gitlab # [ 242.203084] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:08.225Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"5e064c34d21e799769dba067","created_at":"2026-08-23T07:14:06.078Z","trace_propagation_headers":{"sentry-trace":"dff9013c1bde4a7d87809bf40878def6-9c85a3fe9d024239","baggage":"sentry-trace_id=dff9013c1bde4a7d87809bf40878def6,sentry-release=Unknown"},"correlation_id":"01M0PQERPD61XC06C394QS1VT8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63ad72aca05100ff21bae62e89dc62b71f6bb5d828b500d5c7f8cf7202d04ebb","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:06.081Z","job_size_bytes":467,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-5e064c34d21e799769dba067: done: 0.786372 sec","job_status":"done","queue_duration_s":1.357564,"scheduling_latency_s":1.357581,"gitaly_calls":7,"gitaly_duration_s":0.108332,"redis_calls":51,"redis_duration_s":0.024211,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.00123,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.006465,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.012354,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002915,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001247,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.601662,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000509842,"duration_s":0.786372,"completed_at":"2026-08-23T07:14:08.225Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.047425,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2098gitlab # [ 242.253180] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:08.228Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"bb6b1c67-9f9f-4e4d-8fea-497fe6a546da\"}"],"class":"WebHookWorker","jid":"4a3afa330696e0f2dfd7acce","created_at":"2026-08-23T07:14:06.224Z","trace_propagation_headers":{"sentry-trace":"dff9013c1bde4a7d87809bf40878def6-9c85a3fe9d024239","baggage":"sentry-trace_id=dff9013c1bde4a7d87809bf40878def6,sentry-release=Unknown"},"correlation_id":"01M0PQERPD61XC06C394QS1VT8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:3fec3d4beeb4c69ea0ad27549aabf8ddfb06504b542c3fae6526c499b79acdc8","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:06.229Z","job_size_bytes":1751,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-4a3afa330696e0f2dfd7acce: start","job_status":"start","queue_duration_s":1.998426,"scheduling_latency_s":1.998458}2099gitlab # [ 242.354798] nixbot[2596]: INFO: ::ffff:127.0.0.1:36228 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2100gitlab # [ 242.380638] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:08.402Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"bb6b1c67-9f9f-4e4d-8fea-497fe6a546da\"}"],"class":"WebHookWorker","jid":"4a3afa330696e0f2dfd7acce","created_at":"2026-08-23T07:14:06.224Z","trace_propagation_headers":{"sentry-trace":"dff9013c1bde4a7d87809bf40878def6-9c85a3fe9d024239","baggage":"sentry-trace_id=dff9013c1bde4a7d87809bf40878def6,sentry-release=Unknown"},"correlation_id":"01M0PQERPD61XC06C394QS1VT8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:3fec3d4beeb4c69ea0ad27549aabf8ddfb06504b542c3fae6526c499b79acdc8","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:06.229Z","job_size_bytes":1751,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-4a3afa330696e0f2dfd7acce: done: 0.174186 sec","job_status":"done","queue_duration_s":1.998426,"scheduling_latency_s":1.998458,"redis_calls":19,"redis_duration_s":0.005529,"redis_read_bytes":32,"redis_write_bytes":5368,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001271,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000487,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3730,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00262,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001151,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.057955969000005325,"cpu_s":0.096132,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000763505,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.174186,"completed_at":"2026-08-23T07:14:08.402Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003869,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2101gitlab # [ 242.455402] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:08.477Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"862e7af8025ed5ffdc743f22","created_at":"2026-08-23T07:14:06.388Z","trace_propagation_headers":{"sentry-trace":"855e2517071340329548f6b061d6a875-5b118984e34a463a","baggage":"sentry-trace_id=855e2517071340329548f6b061d6a875,sentry-release=Unknown"},"correlation_id":"01M0PQEWDY51YW9A7KXEFMDKX9","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"27148a65639d0480332be850","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:06.391Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-862e7af8025ed5ffdc743f22: start","job_status":"start","queue_duration_s":2.086784,"scheduling_latency_s":2.086828}2102gitlab # [ 242.488819] gitaly[923]: time="2026-08-23T07:14:08.511Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQGDWWAEQNZDAS6YG9MX78 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:14:08.505" grpc.time_ms=6.204 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc2103gitlab # [ 242.499665] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:14:08 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 992104gitlab # [ 242.508454] gitaly[923]: time="2026-08-23T07:14:08.531Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEWDY51YW9A7KXEFMDKX9 diskcache=50c449db-91cb-4216-93cb-85806931fac0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-23T13:14:08.517" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:14:08.518" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2105gitlab # [ 242.509586] gitaly[923]: time="2026-08-23T07:14:08.531Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=317 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEWDY51YW9A7KXEFMDKX9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-23T13:14:08.517" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:14:08.518" grpc.time_ms=13.491 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2106gitlab # [ 242.534952] gitaly[923]: time="2026-08-23T07:14:08.558Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQGE02RB2P061N8MNT99DR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:14:08.547" pid=923 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2107gitlab # [ 242.543237] gitaly[923]: time="2026-08-23T07:14:08.558Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQGE02RB2P061N8MNT99DR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:14:08.547" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc2108gitlab # [ 242.554250] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:08.562Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"862e7af8025ed5ffdc743f22","created_at":"2026-08-23T07:14:06.388Z","trace_propagation_headers":{"sentry-trace":"855e2517071340329548f6b061d6a875-5b118984e34a463a","baggage":"sentry-trace_id=855e2517071340329548f6b061d6a875,sentry-release=Unknown"},"correlation_id":"01M0PQEWDY51YW9A7KXEFMDKX9","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"27148a65639d0480332be850","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:06.391Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-862e7af8025ed5ffdc743f22: done: 0.085148 sec","job_status":"done","queue_duration_s":2.086784,"scheduling_latency_s":2.086828,"gitaly_calls":1,"gitaly_duration_s":0.034844,"redis_calls":12,"redis_duration_s":0.0035570000000000003,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001226,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00121,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001121,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028044,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.048775194,"duration_s":0.085148,"completed_at":"2026-08-23T07:14:08.562Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00363,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2109gitlab # [ 242.558315] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:08.564Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"99d7e312d92e79f7b3a2cb54","created_at":"2026-08-23T07:14:06.494Z","trace_propagation_headers":{"sentry-trace":"855e2517071340329548f6b061d6a875-5b118984e34a463a","baggage":"sentry-trace_id=855e2517071340329548f6b061d6a875,sentry-release=Unknown"},"correlation_id":"01M0PQEWDY51YW9A7KXEFMDKX9","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:66cae67894bf7363511af9677e6d8a20d382462145589d659e5db48b154bf5e7","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:06.496Z","job_size_bytes":467,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-99d7e312d92e79f7b3a2cb54: start","job_status":"start","queue_duration_s":2.067229,"scheduling_latency_s":2.067245}2110gitlab # [ 242.595738] gitlab-workhorse[825]: time="2026-08-23T07:14:08Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672111gitlab # [ 242.596415] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:14:08 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 532112gitlab # [ 242.596893] gitaly[923]: time="2026-08-23T07:14:08.558Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQGE02RB2P061N8MNT99DR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:14:08.547" grpc.time_ms=11.371 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc2113gitlab # [ 242.597628] nixbot[2596]: {"ts": "2026-08-23T07:14:08.607Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2114gitlab # [ 242.598076] gitaly[923]: time="2026-08-23T07:14:08.582Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEWDY51YW9A7KXEFMDKX9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:14:38.580" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:14:08.581" grpc.time_ms=0.564 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2115gitlab # [ 242.629410] gitaly[923]: time="2026-08-23T07:14:08.652Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQGE39CJKPT0WYYXG1J9D3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:14:38.251" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:14:08.651" grpc.time_ms=0.616 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2116gitlab # [ 242.649785] gitaly[923]: time="2026-08-23T07:14:08.673Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEWDY51YW9A7KXEFMDKX9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-23T07:14:18.025" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:14:08.666" grpc.time_ms=6.69 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2117gitlab # [ 242.674910] gitaly[923]: time="2026-08-23T07:14:08.698Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQGE39CJKPT0WYYXG1J9D3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:14:18.122" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:14:08.693" grpc.time_ms=4.958 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2118gitlab # [ 242.685529] gitaly[923]: time="2026-08-23T07:14:08.708Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQEWDY51YW9A7KXEFMDKX9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-23T07:14:38.707" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:14:08.708" grpc.time_ms=0.668 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2119gitlab # [ 242.691895] gitaly[923]: time="2026-08-23T07:14:08.715Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=322 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQEWDY51YW9A7KXEFMDKX9 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-23T07:14:38.711" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:14:08.712" grpc.time_ms=3.009 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2120gitlab # [ 242.720430] gitaly[923]: time="2026-08-23T07:14:08.743Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0PQEWDY51YW9A7KXEFMDKX9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:14:18.097" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:14:08.737" grpc.time_ms=5.975 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2121gitlab # [ 242.730122] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:14:08 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3646acbf947650c454ec92b605947ed1f4893ec6 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 1352122gitlab # [ 242.733244] nixbot[2596]: {"ts": "2026-08-23T07:14:08.754Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/3646acbf947650c454ec92b605947ed1f4893ec6 \"HTTP/1.1 201 Created\""}2123gitlab # [ 242.767024] gitaly[923]: time="2026-08-23T07:14:08.790Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQGE7MN96W41YCQZVW6KM4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:14:38.489" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:14:08.789" grpc.time_ms=0.558 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2124gitlab # [ 242.814495] gitaly[923]: time="2026-08-23T07:14:08.837Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0PQGE7MN96W41YCQZVW6KM4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:14:18.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:14:08.832" grpc.time_ms=4.981 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2125gitlab # [ 242.846102] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:14:08 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3646acbf947650c454ec92b605947ed1f4893ec6 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1122126gitlab # [ 242.848533] nixbot[2596]: {"ts": "2026-08-23T07:14:08.870Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/3646acbf947650c454ec92b605947ed1f4893ec6 \"HTTP/1.1 201 Created\""}2127gitlab # [ 242.889645] gitaly[923]: time="2026-08-23T07:14:08.912Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQGEBBX0XVAF1VXHE0YY2J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:14:38.611" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:14:08.911" grpc.time_ms=0.638 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2128gitlab # [ 242.923943] gitaly[923]: time="2026-08-23T07:14:08.947Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0PQGEBBX0XVAF1VXHE0YY2J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:14:18.110" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:14:08.941" grpc.time_ms=6.084 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2129gitlab # [ 242.970097] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:14:08 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3646acbf947650c454ec92b605947ed1f4893ec6 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1142130gitlab # [ 242.970846] nixbot[2596]: {"ts": "2026-08-23T07:14:08.991Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/3646acbf947650c454ec92b605947ed1f4893ec6 \"HTTP/1.1 201 Created\""}2131gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'2132gitlab # [ 243.013974] gitaly[923]: time="2026-08-23T07:14:09.037Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=964 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M0PQEWDY51YW9A7KXEFMDKX9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-23T07:14:39.025" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:14:09.026" grpc.time_ms=10.945 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2133gitlab # [ 243.036885] gitaly[923]: time="2026-08-23T07:14:09.060Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0PQEWDY51YW9A7KXEFMDKX9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-23T07:14:39.051" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:14:09.051" grpc.time_ms=8.219 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2134gitlab # [ 243.041239] gitaly[923]: time="2026-08-23T07:14:09.064Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQGEG4NHF096T1CP3BJRAZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:14:09.059" grpc.time_ms=4.863 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc2135gitlab # [ 243.056460] nixbot[2596]: INFO: ::ffff:127.0.0.1:52954 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK2136gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 0.05 seconds)2137gitlab # [ 243.064947] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:14:09 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 592138gitlab # [ 243.072477] sidekiq-cluster[2577]: {"severity":"WARN","time":"2026-08-23T07:14:09.095Z","class":"CreatePipelineWorker","correlation_id":"01M0PQEWDY51YW9A7KXEFMDKX9","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"3646acbf947650c454ec92b605947ed1f4893ec6","after":"980b228ea51cf3fdbab6e682314494429da25dba","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"980b228ea51cf3fdbab6e682314494429da25dba","ref":"refs/heads/master"},"retry":0}2139gitlab # [ 243.077567] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:09.100Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"99d7e312d92e79f7b3a2cb54","created_at":"2026-08-23T07:14:06.494Z","trace_propagation_headers":{"sentry-trace":"855e2517071340329548f6b061d6a875-5b118984e34a463a","baggage":"sentry-trace_id=855e2517071340329548f6b061d6a875,sentry-release=Unknown"},"correlation_id":"01M0PQEWDY51YW9A7KXEFMDKX9","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:66cae67894bf7363511af9677e6d8a20d382462145589d659e5db48b154bf5e7","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:06.496Z","job_size_bytes":467,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-99d7e312d92e79f7b3a2cb54: done: 0.536435 sec","job_status":"done","queue_duration_s":2.067229,"scheduling_latency_s":2.067245,"gitaly_calls":7,"gitaly_duration_s":0.18051,"redis_calls":33,"redis_duration_s":0.011885999999999999,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000587,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001247,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.008976,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001076,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.331428,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.536435,"completed_at":"2026-08-23T07:14:09.100Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012904,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2140gitlab # [ 243.082146] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:09.104Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"7d14186b-76dd-4e7b-b83b-c4c07f8688b9\"}"],"class":"WebHookWorker","jid":"8838d566a9d75c8717b32fd4","created_at":"2026-08-23T07:14:06.507Z","trace_propagation_headers":{"sentry-trace":"855e2517071340329548f6b061d6a875-5b118984e34a463a","baggage":"sentry-trace_id=855e2517071340329548f6b061d6a875,sentry-release=Unknown"},"correlation_id":"01M0PQEWDY51YW9A7KXEFMDKX9","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a84110594c9ddd7dec51e2f97bea24edba41ac39a6044c612820065490312280","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:06.509Z","job_size_bytes":1749,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-8838d566a9d75c8717b32fd4: start","job_status":"start","queue_duration_s":2.594967,"scheduling_latency_s":2.594988}2141gitlab # [ 243.110349] gitaly[923]: time="2026-08-23T07:14:09.133Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQGEJ3ZRN8TNSFK0WFPD92 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:14:09.127" pid=923 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2142gitlab # [ 243.111226] gitaly[923]: time="2026-08-23T07:14:09.133Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQGEJ3ZRN8TNSFK0WFPD92 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:14:09.127" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc2143gitlab # [ 243.121205] gitlab-workhorse[825]: time="2026-08-23T07:14:09Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672144gitlab # [ 243.122840] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:14:09 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 432145gitlab # [ 243.124735] gitaly[923]: time="2026-08-23T07:14:09.134Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQGEJ3ZRN8TNSFK0WFPD92 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:14:09.127" grpc.time_ms=6.146 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc2146gitlab # [ 243.236728] nix-daemon[2805]: accepted connection from pid 3270, user nixbot2147gitlab # [ 243.259395] nixbot[2596]: INFO: ::ffff:127.0.0.1:52962 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2148gitlab # [ 243.268757] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:09.291Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"7d14186b-76dd-4e7b-b83b-c4c07f8688b9\"}"],"class":"WebHookWorker","jid":"8838d566a9d75c8717b32fd4","created_at":"2026-08-23T07:14:06.507Z","trace_propagation_headers":{"sentry-trace":"855e2517071340329548f6b061d6a875-5b118984e34a463a","baggage":"sentry-trace_id=855e2517071340329548f6b061d6a875,sentry-release=Unknown"},"correlation_id":"01M0PQEWDY51YW9A7KXEFMDKX9","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a84110594c9ddd7dec51e2f97bea24edba41ac39a6044c612820065490312280","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:06.509Z","job_size_bytes":1749,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-8838d566a9d75c8717b32fd4: done: 0.187546 sec","job_status":"done","queue_duration_s":2.594967,"scheduling_latency_s":2.594988,"redis_calls":14,"redis_duration_s":0.002169,"redis_read_bytes":26,"redis_write_bytes":4682,"redis_queues_calls":2,"redis_queues_duration_s":0.000371,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3726,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001097,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000701,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.097,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.097,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.00398430500001723,"cpu_s":0.080323,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.187546,"completed_at":"2026-08-23T07:14:09.291Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.096565,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2149gitlab # [ 243.310505] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:09.302Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"fa26c3a9bc3ff67ff807819a","created_at":"2026-08-23T07:14:06.822Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-07e5ec2cff8b4976","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:06.826Z","job_size_bytes":23,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-fa26c3a9bc3ff67ff807819a: start","job_status":"start","queue_duration_s":2.476126,"scheduling_latency_s":2.476152}2150gitlab # [ 243.330045] gitaly[923]: time="2026-08-23T07:14:09.353Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=12 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQGERMT8T41H5AQ4ZPQPZD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:14:09.335" grpc.time_ms=17.559 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc2151gitlab # [ 243.341045] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:14:09 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 522152gitlab # [ 243.342919] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:09.359Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"fa26c3a9bc3ff67ff807819a","created_at":"2026-08-23T07:14:06.822Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-07e5ec2cff8b4976","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:06.826Z","job_size_bytes":23,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-fa26c3a9bc3ff67ff807819a: done: 0.057137 sec","job_status":"done","queue_duration_s":2.476126,"scheduling_latency_s":2.476152,"redis_calls":10,"redis_duration_s":0.0021550000000000002,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000255,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001105,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000795,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042593,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000358705,"duration_s":0.057137,"completed_at":"2026-08-23T07:14:09.359Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00981,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2153gitlab # [ 243.378720] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:09.361Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"58d443a1dbef1dbe45552fa9","created_at":"2026-08-23T07:14:06.962Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-07e5ec2cff8b4976","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:06.967Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-58d443a1dbef1dbe45552fa9: start","job_status":"start","queue_duration_s":2.393899,"scheduling_latency_s":2.393914}2154gitlab # [ 243.392688] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:09.384Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"58d443a1dbef1dbe45552fa9","created_at":"2026-08-23T07:14:06.962Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-07e5ec2cff8b4976","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:06.967Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-58d443a1dbef1dbe45552fa9: done: 0.023705 sec","job_status":"done","queue_duration_s":2.393899,"scheduling_latency_s":2.393914,"redis_calls":10,"redis_duration_s":0.003276,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000268,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002555,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000453,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013967,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000264,"duration_s":0.023705,"completed_at":"2026-08-23T07:14:09.384Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00326,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2155gitlab # [ 243.393594] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:09.385Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"c220f1998c62fa0e6cee3039","created_at":"2026-08-23T07:14:06.978Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-07e5ec2cff8b4976","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:06.983Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-c220f1998c62fa0e6cee3039: start","job_status":"start","queue_duration_s":2.402487,"scheduling_latency_s":2.402501}2156gitlab # [ 243.431821] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:09.406Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"c220f1998c62fa0e6cee3039","created_at":"2026-08-23T07:14:06.978Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-07e5ec2cff8b4976","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:06.983Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-c220f1998c62fa0e6cee3039: done: 0.021097 sec","job_status":"done","queue_duration_s":2.402487,"scheduling_latency_s":2.402501,"redis_calls":10,"redis_duration_s":0.001209,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000242,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00073,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000237,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013361,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000193321,"duration_s":0.021097,"completed_at":"2026-08-23T07:14:09.406Z","load_balancing_strategy":"primary","db_duration_s":0.003714,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2157gitlab # [ 243.439528] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:09.407Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"a24e8ff815135200243cefa2","created_at":"2026-08-23T07:14:06.993Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-07e5ec2cff8b4976","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:06.996Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-a24e8ff815135200243cefa2: start","job_status":"start","queue_duration_s":2.410885,"scheduling_latency_s":2.410897}2158gitlab # [ 243.484441] gitlab-workhorse[825]: time="2026-08-23T07:14:09Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672159gitlab # [ 243.485087] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:14:09 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 652160gitlab # [ 243.485479] gitaly[923]: time="2026-08-23T07:14:09.419Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQGETBX58BT29HTWQN74NQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:14:09.408" pid=923 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2161gitlab # [ 243.486310] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:09.490Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"a24e8ff815135200243cefa2","created_at":"2026-08-23T07:14:06.993Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-07e5ec2cff8b4976","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:06.996Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-a24e8ff815135200243cefa2: done: 0.08325 sec","job_status":"done","queue_duration_s":2.410885,"scheduling_latency_s":2.410897,"redis_calls":13,"redis_duration_s":0.002035,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000351,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000991,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000398,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000295,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019059,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00019807,"duration_s":0.08325,"completed_at":"2026-08-23T07:14:09.490Z","load_balancing_strategy":"primary","db_duration_s":0.003764,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2162gitlab # [ 243.499613] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:09.493Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"88cb07f255a5d4205965c729","created_at":"2026-08-23T07:14:06.997Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-07e5ec2cff8b4976","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:06.999Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-88cb07f255a5d4205965c729: start","job_status":"start","queue_duration_s":2.493914,"scheduling_latency_s":2.493932}2163gitlab # [ 243.513445] gitaly[923]: time="2026-08-23T07:14:09.419Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQGETBX58BT29HTWQN74NQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:14:09.408" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc2164gitlab # [ 243.550225] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:09.520Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"88cb07f255a5d4205965c729","created_at":"2026-08-23T07:14:06.997Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-07e5ec2cff8b4976","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:06.999Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-88cb07f255a5d4205965c729: done: 0.026889 sec","job_status":"done","queue_duration_s":2.493914,"scheduling_latency_s":2.493932,"redis_calls":10,"redis_duration_s":0.0019529999999999999,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000329,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001148,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000476,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016717,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000236901,"duration_s":0.026889,"completed_at":"2026-08-23T07:14:09.520Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003825,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2165gitlab # [ 243.559628] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:09.521Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"7712bbec136ddfb3940dd21e","created_at":"2026-08-23T07:14:06.999Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-07e5ec2cff8b4976","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:07.002Z","job_size_bytes":19,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-7712bbec136ddfb3940dd21e: start","job_status":"start","queue_duration_s":2.519125,"scheduling_latency_s":2.519141}2166gitlab # [ 243.604385] gitaly[923]: time="2026-08-23T07:14:09.419Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQGETBX58BT29HTWQN74NQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:14:09.408" grpc.time_ms=10.931 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc2167gitlab # [ 243.605186] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:09.547Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"7712bbec136ddfb3940dd21e","created_at":"2026-08-23T07:14:06.999Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-07e5ec2cff8b4976","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:07.002Z","job_size_bytes":19,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-7712bbec136ddfb3940dd21e: done: 0.025906 sec","job_status":"done","queue_duration_s":2.519125,"scheduling_latency_s":2.519141,"redis_calls":11,"redis_duration_s":0.007124,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001053,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00457,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001501,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012808,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00099007,"duration_s":0.025906,"completed_at":"2026-08-23T07:14:09.547Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002755,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2168gitlab # [ 243.645818] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:09.550Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"7e501fcbbe070cdf196bbcac","created_at":"2026-08-23T07:14:07.004Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-07e5ec2cff8b4976","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:07.006Z","job_size_bytes":66,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-7e501fcbbe070cdf196bbcac: start","job_status":"start","queue_duration_s":2.544359,"scheduling_latency_s":2.544373}2169gitlab # [ 243.646613] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:09.578Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"7e501fcbbe070cdf196bbcac","created_at":"2026-08-23T07:14:07.004Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-07e5ec2cff8b4976","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:07.006Z","job_size_bytes":66,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-7e501fcbbe070cdf196bbcac: done: 0.028314 sec","job_status":"done","queue_duration_s":2.544359,"scheduling_latency_s":2.544373,"redis_calls":10,"redis_duration_s":0.001666,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000317,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00102,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000329,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01597,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000209524,"duration_s":0.028314,"completed_at":"2026-08-23T07:14:09.578Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006929,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2170gitlab # [ 243.685687] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:09.579Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"0399f3407fbda2dea90e7b78","created_at":"2026-08-23T07:14:07.006Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-07e5ec2cff8b4976","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:07.009Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-0399f3407fbda2dea90e7b78: start","job_status":"start","queue_duration_s":2.570768,"scheduling_latency_s":2.570781}2171gitlab # [ 243.686708] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:14:09 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1192172gitlab # [ 243.687683] gitlab-workhorse[825]: time="2026-08-23T07:14:09Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162173gitlab # [ 243.688343] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:14:09 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 582174gitlab # [ 243.688786] gitaly[923]: time="2026-08-23T07:14:09.631Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQGEZ736YTKGKGVBFP6S0P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:14:09.624" grpc.time_ms=6.655 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc2175gitlab # [ 243.698832] gitaly[923]: time="2026-08-23T07:14:09.691Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQGF31CFDYTT7P7KJ2FHP3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:14:09.679" pid=923 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2176gitlab # [ 243.739415] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:09.605Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"0399f3407fbda2dea90e7b78","created_at":"2026-08-23T07:14:07.006Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-07e5ec2cff8b4976","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:07.009Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-0399f3407fbda2dea90e7b78: done: 0.025566 sec","job_status":"done","queue_duration_s":2.570768,"scheduling_latency_s":2.570781,"redis_calls":10,"redis_duration_s":0.001843,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00031,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000842,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000691,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017266,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000200305,"duration_s":0.025566,"completed_at":"2026-08-23T07:14:09.605Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003393,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2177gitlab # [ 243.741649] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:09.606Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"88d031c970092bc71c9d29c1","created_at":"2026-08-23T07:14:07.012Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-07e5ec2cff8b4976","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:07.015Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-88d031c970092bc71c9d29c1: start","job_status":"start","queue_duration_s":2.591289,"scheduling_latency_s":2.591303}2178gitlab # [ 243.755075] gitaly[923]: time="2026-08-23T07:14:09.691Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1169 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQGF31CFDYTT7P7KJ2FHP3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:14:09.679" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc2179gitlab # [ 243.792914] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:09.632Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"88d031c970092bc71c9d29c1","created_at":"2026-08-23T07:14:07.012Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-07e5ec2cff8b4976","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:07.015Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-88d031c970092bc71c9d29c1: done: 0.025925 sec","job_status":"done","queue_duration_s":2.591289,"scheduling_latency_s":2.591303,"redis_calls":10,"redis_duration_s":0.0016899999999999999,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000298,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001053,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000339,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014348,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000349765,"duration_s":0.025925,"completed_at":"2026-08-23T07:14:09.632Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006054,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2180gitlab # [ 243.832565] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:09.633Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"94c7a25c82d21ea79769dab7","created_at":"2026-08-23T07:14:07.015Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-07e5ec2cff8b4976","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:07.017Z","job_size_bytes":6,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-94c7a25c82d21ea79769dab7: start","job_status":"start","queue_duration_s":2.615726,"scheduling_latency_s":2.615742}2181gitlab # [ 243.833229] gitaly[923]: time="2026-08-23T07:14:09.691Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1169 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQGF31CFDYTT7P7KJ2FHP3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:14:09.679" grpc.time_ms=11.947 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc2182gitlab # [ 243.833790] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:09.649Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"94c7a25c82d21ea79769dab7","created_at":"2026-08-23T07:14:07.015Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-07e5ec2cff8b4976","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:07.017Z","job_size_bytes":6,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-94c7a25c82d21ea79769dab7: done: 0.016533 sec","job_status":"done","queue_duration_s":2.615726,"scheduling_latency_s":2.615742,"redis_calls":10,"redis_duration_s":0.0015259999999999998,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000267,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001017,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000242,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009321,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000196952,"duration_s":0.016533,"completed_at":"2026-08-23T07:14:09.649Z","load_balancing_strategy":"primary","db_duration_s":0.001699,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2183gitlab # [ 243.862873] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:09.650Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"681aa30e0ca8de94c04d7d6c","created_at":"2026-08-23T07:14:07.018Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-07e5ec2cff8b4976","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:07.020Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-681aa30e0ca8de94c04d7d6c: start","job_status":"start","queue_duration_s":2.630344,"scheduling_latency_s":2.630356}2184gitlab # [ 243.906292] gitaly[923]: time="2026-08-23T07:14:09.782Z" level=info msg="finished unary call with code OK" catfile.duration_ms=10 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=10 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQGF5Z5FF94K7VS7J0MT26 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:14:39.470" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:14:09.771" grpc.time_ms=11.046 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2185gitlab # [ 243.906921] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:09.677Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"681aa30e0ca8de94c04d7d6c","created_at":"2026-08-23T07:14:07.018Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-07e5ec2cff8b4976","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:07.020Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-681aa30e0ca8de94c04d7d6c: done: 0.026573 sec","job_status":"done","queue_duration_s":2.630344,"scheduling_latency_s":2.630356,"redis_calls":10,"redis_duration_s":0.002117,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000687,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00092,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00051,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016369,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000300317,"duration_s":0.026573,"completed_at":"2026-08-23T07:14:09.677Z","load_balancing_strategy":"primary","db_duration_s":0.004773,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2186gitlab # [ 243.920303] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:09.678Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"ec0d0ba741601b08b13dd463","created_at":"2026-08-23T07:14:07.024Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-07e5ec2cff8b4976","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:07.026Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-ec0d0ba741601b08b13dd463: start","job_status":"start","queue_duration_s":2.652082,"scheduling_latency_s":2.652097}2187gitlab # [ 243.933851] gitaly[923]: time="2026-08-23T07:14:09.797Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=4 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0PQGF5Z5FF94K7VS7J0MT26 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-23T07:14:39.488" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:14:09.788" grpc.time_ms=9.258 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2188gitlab # [ 243.969565] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:09.724Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"ec0d0ba741601b08b13dd463","created_at":"2026-08-23T07:14:07.024Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-07e5ec2cff8b4976","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:07.026Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-ec0d0ba741601b08b13dd463: done: 0.045726 sec","job_status":"done","queue_duration_s":2.652082,"scheduling_latency_s":2.652097,"redis_calls":14,"redis_duration_s":0.003696,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000813,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001735,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001148,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028805,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000223492,"duration_s":0.045726,"completed_at":"2026-08-23T07:14:09.724Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009865,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2189gitlab # [ 244.004616] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:09.725Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"42031d3b0e24d2fb8608f620","created_at":"2026-08-23T07:14:07.137Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-07e5ec2cff8b4976","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:07.139Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-42031d3b0e24d2fb8608f620: start","job_status":"start","queue_duration_s":2.586042,"scheduling_latency_s":2.586057}2190gitlab # [ 244.005432] nixbot[2596]: {"ts": "2026-08-23T07:14:09.978Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/980b228ea51cf3fdbab6e682314494429da25dba \"HTTP/1.1 201 Created\""}2191gitlab # [ 244.006097] nixbot[2596]: {"ts": "2026-08-23T07:14:09.983Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-980b228ea51c-4"}2192gitlab # [ 244.006511] gitaly[923]: time="2026-08-23T07:14:09.800Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQEXH0ES8SKGJ91J3Y2W5D grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3890 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:14:09.800" grpc.time_ms=0.329 pid=923 span.kind=server system=grpc2193gitlab # [ 244.007174] gitaly[923]: time="2026-08-23T07:14:09.806Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQGF5Z5FF94K7VS7J0MT26 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:14:19.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:14:09.801" grpc.time_ms=4.773 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2194gitlab # [ 244.043267] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:14:09 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 2512195gitlab # [ 244.043843] nix-daemon[2805]: accepted connection from pid 3360, user nixbot2196gitlab # [ 244.044399] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:09.944Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"42031d3b0e24d2fb8608f620","created_at":"2026-08-23T07:14:07.137Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-07e5ec2cff8b4976","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:07.139Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2577,"job_status":"rescheduled","message":"PipelineProcessWorker JID-42031d3b0e24d2fb8608f620: rescheduled"}2197gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba'2198gitlab # [ 244.044974] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:09.951Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"42031d3b0e24d2fb8608f620","created_at":"2026-08-23T07:14:07.137Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-07e5ec2cff8b4976","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:07.139Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-42031d3b0e24d2fb8608f620: done: 0.225721 sec","job_status":"done","queue_duration_s":2.586042,"scheduling_latency_s":2.586057,"gitaly_calls":3,"gitaly_duration_s":0.102174,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.014439,"redis_read_bytes":149,"redis_write_bytes":18013,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000638,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000564,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.002887,"redis_queues_read_bytes":27,"redis_queues_write_bytes":12312,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.006453,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000152,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000457,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.00265,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.085683,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.198510704,"duration_s":0.225721,"completed_at":"2026-08-23T07:14:09.951Z","load_balancing_strategy":"primary","db_duration_s":0.027091,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2199gitlab # [ 244.102032] gitaly[923]: time="2026-08-23T07:14:09.821Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQGF5Z5FF94K7VS7J0MT26 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-23T07:14:19.021" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:14:09.821" grpc.time_ms=0.148 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2200gitlab # [ 244.102610] gitaly[923]: time="2026-08-23T07:14:09.824Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQEXH0ES8SKGJ91J3Y2W5D grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3888 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:14:09.823" grpc.time_ms=0.275 pid=923 span.kind=server system=grpc2201gitlab # [ 244.103694] nixbot[2596]: {"ts": "2026-08-23T07:14:10.084Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-980b228ea51c-4", "argv0": "bwrap"}2202gitlab # [ 244.104157] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:09.953Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"ab3b2f305ec3c520ecc6b875","created_at":"2026-08-23T07:14:07.262Z","trace_propagation_headers":{"sentry-trace":"dff9013c1bde4a7d87809bf40878def6-ca76c8bcf6c14f1c","baggage":"sentry-trace_id=dff9013c1bde4a7d87809bf40878def6,sentry-release=Unknown"},"correlation_id":"01M0PQERPD61XC06C394QS1VT8","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:07.267Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-ab3b2f305ec3c520ecc6b875: start","job_status":"start","queue_duration_s":2.68599,"scheduling_latency_s":2.68601}2203gitlab # [ 244.104692] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:09.987Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"ab3b2f305ec3c520ecc6b875","created_at":"2026-08-23T07:14:07.262Z","trace_propagation_headers":{"sentry-trace":"dff9013c1bde4a7d87809bf40878def6-ca76c8bcf6c14f1c","baggage":"sentry-trace_id=dff9013c1bde4a7d87809bf40878def6,sentry-release=Unknown"},"correlation_id":"01M0PQERPD61XC06C394QS1VT8","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:07.267Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-ab3b2f305ec3c520ecc6b875: done: 0.034039 sec","job_status":"done","queue_duration_s":2.68599,"scheduling_latency_s":2.68601,"redis_calls":19,"redis_duration_s":0.00354,"redis_read_bytes":22,"redis_write_bytes":4292,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000952,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000349,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2263,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001752,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000487,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021121,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.005439518,"duration_s":0.034039,"completed_at":"2026-08-23T07:14:09.987Z","load_balancing_strategy":"primary","db_duration_s":0.005749,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2204gitlab # [ 244.151155] nix-daemon[2805]: accepted connection from pid 3368, user nixbot2205gitlab # [ 244.151763] gitaly[923]: time="2026-08-23T07:14:09.831Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQGF5Z5FF94K7VS7J0MT26 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-23T07:14:19.024" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:14:09.824" grpc.time_ms=6.895 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2206gitlab # [ 244.152458] gitaly[923]: time="2026-08-23T07:14:09.842Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQEXH0ES8SKGJ91J3Y2W5D grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3890 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:14:09.842" grpc.time_ms=0.233 pid=923 span.kind=server system=grpc2207gitlab # [ 244.153084] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:09.988Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","4a3afa330696e0f2dfd7acce"],"class":"WebHooks::LogExecutionWorker","jid":"1777a30fb7d687529c1deff0","created_at":"2026-08-23T07:14:08.381Z","trace_propagation_headers":{"sentry-trace":"dff9013c1bde4a7d87809bf40878def6-0a1661f46b534c62","baggage":"sentry-trace_id=dff9013c1bde4a7d87809bf40878def6,sentry-release=Unknown"},"correlation_id":"01M0PQERPD61XC06C394QS1VT8","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:03ec2d7c068580f70fc7827a3dfb7bf77811a3a9eea79807ded635ec9a66c384","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:08.390Z","job_size_bytes":2593,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-1777a30fb7d687529c1deff0: start","job_status":"start","queue_duration_s":1.598304,"scheduling_latency_s":1.598318}2208gitlab # [ 244.166634] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:10.017Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","4a3afa330696e0f2dfd7acce"],"class":"WebHooks::LogExecutionWorker","jid":"1777a30fb7d687529c1deff0","created_at":"2026-08-23T07:14:08.381Z","trace_propagation_headers":{"sentry-trace":"dff9013c1bde4a7d87809bf40878def6-0a1661f46b534c62","baggage":"sentry-trace_id=dff9013c1bde4a7d87809bf40878def6,sentry-release=Unknown"},"correlation_id":"01M0PQERPD61XC06C394QS1VT8","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:03ec2d7c068580f70fc7827a3dfb7bf77811a3a9eea79807ded635ec9a66c384","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:08.390Z","job_size_bytes":2593,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-1777a30fb7d687529c1deff0: done: 0.028483 sec","job_status":"done","queue_duration_s":1.598304,"scheduling_latency_s":1.598318,"redis_calls":10,"redis_duration_s":0.001305,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000278,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000779,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000248,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019084,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000231873,"duration_s":0.028483,"completed_at":"2026-08-23T07:14:10.017Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005382,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2209gitlab # [ 244.210625] gitaly[923]: time="2026-08-23T07:14:09.851Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEXH0ES8SKGJ91J3Y2W5D diskcache=382087e1-13b8-4630-bb0f-d0f29a34e846 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T07:14:39.780" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:14:09.780" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2210gitlab # [ 244.211123] gitaly[923]: time="2026-08-23T07:14:09.867Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=62 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7146 command.oublock=0 command.real_time_ms=64 command.spawn_token_fork_ms=0 command.system_time_ms=40 command.user_time_ms=22 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEXH0ES8SKGJ91J3Y2W5D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T07:14:39.780" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:14:09.780" grpc.time_ms=70.733 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2211gitlab # [ 244.220921] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:10.018Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","8838d566a9d75c8717b32fd4"],"class":"WebHooks::LogExecutionWorker","jid":"785063446dcc2337047a52d6","created_at":"2026-08-23T07:14:09.283Z","trace_propagation_headers":{"sentry-trace":"855e2517071340329548f6b061d6a875-8aaf446a7bbd4488","baggage":"sentry-trace_id=855e2517071340329548f6b061d6a875,sentry-release=Unknown"},"correlation_id":"01M0PQEWDY51YW9A7KXEFMDKX9","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0898e416968e93fbbd3a58b8c178a756ef0b2d23c826a7e68134a1197d787d04","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:09.285Z","job_size_bytes":2592,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-785063446dcc2337047a52d6: start","job_status":"start","queue_duration_s":0.733065,"scheduling_latency_s":0.733079}2212gitlab # [ 244.234657] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:10.039Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","8838d566a9d75c8717b32fd4"],"class":"WebHooks::LogExecutionWorker","jid":"785063446dcc2337047a52d6","created_at":"2026-08-23T07:14:09.283Z","trace_propagation_headers":{"sentry-trace":"855e2517071340329548f6b061d6a875-8aaf446a7bbd4488","baggage":"sentry-trace_id=855e2517071340329548f6b061d6a875,sentry-release=Unknown"},"correlation_id":"01M0PQEWDY51YW9A7KXEFMDKX9","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0898e416968e93fbbd3a58b8c178a756ef0b2d23c826a7e68134a1197d787d04","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:09.285Z","job_size_bytes":2592,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-785063446dcc2337047a52d6: done: 0.02104 sec","job_status":"done","queue_duration_s":0.733065,"scheduling_latency_s":0.733079,"redis_calls":7,"redis_duration_s":0.001914,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001673,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000241,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010492,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02104,"completed_at":"2026-08-23T07:14:10.039Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010371,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2213gitlab # [ 244.272632] gitaly[923]: time="2026-08-23T07:14:09.874Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQGF5Z5FF94K7VS7J0MT26 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4146 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:14:09.873" grpc.time_ms=0.727 pid=923 span.kind=server system=grpc2214gitlab # [ 244.276573] gitaly[923]: time="2026-08-23T07:14:09.896Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQGF5Z5FF94K7VS7J0MT26 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:14:09.896" grpc.time_ms=0.35 pid=923 span.kind=server system=grpc2215gitlab # [ 244.312672] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:10.040Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"3314e56f5a59df985ae42a0b","created_at":"2026-08-23T07:14:09.764Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-85dec7d89f1b4d6f","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:09.767Z","job_size_bytes":23,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-3314e56f5a59df985ae42a0b: start","job_status":"start","queue_duration_s":0.272607,"scheduling_latency_s":0.27262}2216gitlab # [ 244.313411] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:10.064Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"3314e56f5a59df985ae42a0b","created_at":"2026-08-23T07:14:09.764Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-85dec7d89f1b4d6f","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:09.767Z","job_size_bytes":23,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-3314e56f5a59df985ae42a0b: done: 0.024499 sec","job_status":"done","queue_duration_s":0.272607,"scheduling_latency_s":0.27262,"redis_calls":7,"redis_duration_s":0.000905,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00066,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000245,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017864,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024499,"completed_at":"2026-08-23T07:14:10.064Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004279,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2217gitlab # [ 244.348132] gitaly[923]: time="2026-08-23T07:14:09.906Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQGF5Z5FF94K7VS7J0MT26 diskcache=c57077f3-244b-4d16-bcce-ee45524cc791 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-23T07:14:19.002" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:14:09.832" pid=923 ref=refs/keep-around/980b228ea51cf3fdbab6e682314494429da25dba remote_ip="2001:db8:1::1" revision=980b228ea51cf3fdbab6e682314494429da25dba span.kind=server system=grpc username=root2218gitlab # [ 244.348664] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:10.065Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"297315df489b82f69eb6c91b","created_at":"2026-08-23T07:14:09.871Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-85dec7d89f1b4d6f","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:09.874Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-297315df489b82f69eb6c91b: start","job_status":"start","queue_duration_s":0.191293,"scheduling_latency_s":0.191308}2219gitlab # [ 244.353521] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:10.083Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"297315df489b82f69eb6c91b","created_at":"2026-08-23T07:14:09.871Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-85dec7d89f1b4d6f","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:09.874Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-297315df489b82f69eb6c91b: done: 0.017524 sec","job_status":"done","queue_duration_s":0.191293,"scheduling_latency_s":0.191308,"redis_calls":7,"redis_duration_s":0.000971,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000716,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000255,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010466,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017524,"completed_at":"2026-08-23T07:14:10.083Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003228,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2220gitlab # [ 244.388525] gitaly[923]: time="2026-08-23T07:14:09.906Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=41 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5105 command.oublock=8 command.real_time_ms=65 command.spawn_token_fork_ms=0 command.system_time_ms=28 command.user_time_ms=13 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQGF5Z5FF94K7VS7J0MT26 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-23T07:14:19.002" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:14:09.832" grpc.time_ms=73.679 pid=923 ref=refs/keep-around/980b228ea51cf3fdbab6e682314494429da25dba remote_ip="2001:db8:1::1" revision=980b228ea51cf3fdbab6e682314494429da25dba span.kind=server system=grpc username=root2221gitlab # [ 244.427945] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:10.084Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"8d5c9792b67d231cd41967cf","created_at":"2026-08-23T07:14:09.879Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-85dec7d89f1b4d6f","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:09.881Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-8d5c9792b67d231cd41967cf: start","job_status":"start","queue_duration_s":0.202123,"scheduling_latency_s":0.202145}2222gitlab # [ 244.428588] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:10.104Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"8d5c9792b67d231cd41967cf","created_at":"2026-08-23T07:14:09.879Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-85dec7d89f1b4d6f","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:09.881Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-8d5c9792b67d231cd41967cf: done: 0.020909 sec","job_status":"done","queue_duration_s":0.202123,"scheduling_latency_s":0.202145,"redis_calls":7,"redis_duration_s":0.000982,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00067,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000312,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01145,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020909,"completed_at":"2026-08-23T07:14:10.104Z","load_balancing_strategy":"primary","db_duration_s":0.006883,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2223gitlab # [ 244.477036] gitaly[923]: time="2026-08-23T07:14:09.911Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQGF5Z5FF94K7VS7J0MT26 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:14:39.610" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:14:09.910" grpc.time_ms=0.751 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2224gitlab # [ 244.477656] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:10.105Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"24fe7ac6d86944f57d4af6f8","created_at":"2026-08-23T07:14:09.888Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-85dec7d89f1b4d6f","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:09.890Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-24fe7ac6d86944f57d4af6f8: start","job_status":"start","queue_duration_s":0.215596,"scheduling_latency_s":0.215614}2225gitlab # [ 244.478356] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:10.136Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"24fe7ac6d86944f57d4af6f8","created_at":"2026-08-23T07:14:09.888Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-85dec7d89f1b4d6f","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:09.890Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-24fe7ac6d86944f57d4af6f8: done: 0.031132 sec","job_status":"done","queue_duration_s":0.215596,"scheduling_latency_s":0.215614,"redis_calls":10,"redis_duration_s":0.0012560000000000002,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000644,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000378,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000234,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013261,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031132,"completed_at":"2026-08-23T07:14:10.136Z","load_balancing_strategy":"primary","db_duration_s":0.015215,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2226gitlab # [ 244.518565] gitaly[923]: time="2026-08-23T07:14:09.913Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQEXH0ES8SKGJ91J3Y2W5D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-23T07:14:39.512" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:14:09.912" grpc.time_ms=1.101 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2227gitlab # [ 244.519162] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:10.137Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"e9078a01899c2d3ed59b79f6","created_at":"2026-08-23T07:14:09.890Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-85dec7d89f1b4d6f","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:09.892Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-e9078a01899c2d3ed59b79f6: start","job_status":"start","queue_duration_s":0.245714,"scheduling_latency_s":0.245729}2228gitlab # [ 244.525042] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:10.152Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"e9078a01899c2d3ed59b79f6","created_at":"2026-08-23T07:14:09.890Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-85dec7d89f1b4d6f","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:09.892Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-e9078a01899c2d3ed59b79f6: done: 0.015095 sec","job_status":"done","queue_duration_s":0.245714,"scheduling_latency_s":0.245729,"redis_calls":7,"redis_duration_s":0.000933,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000679,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000254,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010359,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015095,"completed_at":"2026-08-23T07:14:10.152Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002326,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2229gitlab # [ 244.570643] gitaly[923]: time="2026-08-23T07:14:09.937Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQEXH0ES8SKGJ91J3Y2W5D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:14:39.536" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:14:09.937" grpc.time_ms=0.45 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2230gitlab # [ 244.571391] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:10.153Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"d9b9703bb7e620a8b71cc55b","created_at":"2026-08-23T07:14:09.892Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-85dec7d89f1b4d6f","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:09.894Z","job_size_bytes":19,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-d9b9703bb7e620a8b71cc55b: start","job_status":"start","queue_duration_s":0.259052,"scheduling_latency_s":0.259066}2231gitlab # [ 244.607730] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:10.168Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"d9b9703bb7e620a8b71cc55b","created_at":"2026-08-23T07:14:09.892Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-85dec7d89f1b4d6f","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:09.894Z","job_size_bytes":19,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-d9b9703bb7e620a8b71cc55b: done: 0.014688 sec","job_status":"done","queue_duration_s":0.259052,"scheduling_latency_s":0.259066,"redis_calls":8,"redis_duration_s":0.000978,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000752,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000226,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00977,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014688,"completed_at":"2026-08-23T07:14:10.168Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002035,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2232gitlab # [ 244.643859] gitaly[923]: time="2026-08-23T07:14:10.340Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQGF5Z5FF94K7VS7J0MT26 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-23T07:14:40.339" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:14:10.339" grpc.time_ms=0.622 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2233gitlab # [ 244.644559] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:10.169Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"3c4ef58f7fa2cc5bdb613256","created_at":"2026-08-23T07:14:09.895Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-85dec7d89f1b4d6f","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:09.896Z","job_size_bytes":66,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-3c4ef58f7fa2cc5bdb613256: start","job_status":"start","queue_duration_s":0.273341,"scheduling_latency_s":0.273354}2234gitlab # [ 244.645365] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:10.182Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"3c4ef58f7fa2cc5bdb613256","created_at":"2026-08-23T07:14:09.895Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-85dec7d89f1b4d6f","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:09.896Z","job_size_bytes":66,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-3c4ef58f7fa2cc5bdb613256: done: 0.013294 sec","job_status":"done","queue_duration_s":0.273341,"scheduling_latency_s":0.273354,"redis_calls":7,"redis_duration_s":0.000858,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000624,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000234,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009261,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013294,"completed_at":"2026-08-23T07:14:10.182Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001376,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2235gitlab # [ 244.692651] gitaly[923]: time="2026-08-23T07:14:10.362Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQGF5Z5FF94K7VS7J0MT26 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:14:40.361" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:14:10.361" grpc.time_ms=0.467 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2236gitlab # [ 244.692874] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:10.183Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"cdfbcec34a8b32bbdd79872c","created_at":"2026-08-23T07:14:09.896Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-85dec7d89f1b4d6f","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:09.897Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-cdfbcec34a8b32bbdd79872c: start","job_status":"start","queue_duration_s":0.286279,"scheduling_latency_s":0.286293}2237gitlab # [ 244.695679] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:10.200Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"cdfbcec34a8b32bbdd79872c","created_at":"2026-08-23T07:14:09.896Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-85dec7d89f1b4d6f","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:09.897Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-cdfbcec34a8b32bbdd79872c: done: 0.01635 sec","job_status":"done","queue_duration_s":0.286279,"scheduling_latency_s":0.286293,"redis_calls":7,"redis_duration_s":0.001058,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000644,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000414,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009957,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01635,"completed_at":"2026-08-23T07:14:10.200Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003605,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2238gitlab # [ 244.731849] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:10.201Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"38006cb71556423b1a0e6145","created_at":"2026-08-23T07:14:09.899Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-85dec7d89f1b4d6f","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:09.901Z","job_size_bytes":6,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-38006cb71556423b1a0e6145: start","job_status":"start","queue_duration_s":0.299944,"scheduling_latency_s":0.299956}2239gitlab # [ 244.741662] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:10.209Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"38006cb71556423b1a0e6145","created_at":"2026-08-23T07:14:09.899Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-85dec7d89f1b4d6f","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:09.901Z","job_size_bytes":6,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-38006cb71556423b1a0e6145: done: 0.008742 sec","job_status":"done","queue_duration_s":0.299944,"scheduling_latency_s":0.299956,"redis_calls":7,"redis_duration_s":0.000834,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000611,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000223,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005694,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008742,"completed_at":"2026-08-23T07:14:10.209Z","load_balancing_strategy":"primary","db_duration_s":0.000262,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2240gitlab # [ 244.778036] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:10.210Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"00117a2607c6fe074bb9d34d","created_at":"2026-08-23T07:14:09.901Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-85dec7d89f1b4d6f","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:09.902Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-00117a2607c6fe074bb9d34d: start","job_status":"start","queue_duration_s":0.308483,"scheduling_latency_s":0.308495}2241gitlab # [ 244.818539] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:10.224Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"00117a2607c6fe074bb9d34d","created_at":"2026-08-23T07:14:09.901Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-85dec7d89f1b4d6f","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:09.902Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-00117a2607c6fe074bb9d34d: done: 0.013741 sec","job_status":"done","queue_duration_s":0.308483,"scheduling_latency_s":0.308495,"redis_calls":7,"redis_duration_s":0.0008500000000000001,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000626,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000224,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009421,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013741,"completed_at":"2026-08-23T07:14:10.224Z","load_balancing_strategy":"primary","db_duration_s":0.001768,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2242gitlab # [ 244.819524] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:10.225Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"2b840d8dc40abbdaca28f823","created_at":"2026-08-23T07:14:09.912Z","trace_propagation_headers":{"sentry-trace":"ddc3e3c9b57a4e83a82d209535745682-7bec41371ac24be5","baggage":"sentry-trace_id=ddc3e3c9b57a4e83a82d209535745682,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQGF5Z5FF94K7VS7J0MT26","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:09.915Z","job_size_bytes":65,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-2b840d8dc40abbdaca28f823: start","job_status":"start","queue_duration_s":0.310337,"scheduling_latency_s":0.31035}2243gitlab # [ 244.858740] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:10.242Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"2b840d8dc40abbdaca28f823","created_at":"2026-08-23T07:14:09.912Z","trace_propagation_headers":{"sentry-trace":"ddc3e3c9b57a4e83a82d209535745682-7bec41371ac24be5","baggage":"sentry-trace_id=ddc3e3c9b57a4e83a82d209535745682,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQGF5Z5FF94K7VS7J0MT26","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:09.915Z","job_size_bytes":65,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-2b840d8dc40abbdaca28f823: done: 0.017244 sec","job_status":"done","queue_duration_s":0.310337,"scheduling_latency_s":0.31035,"redis_calls":7,"redis_duration_s":0.0008810000000000001,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000647,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000234,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011897,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017244,"completed_at":"2026-08-23T07:14:10.242Z","load_balancing_strategy":"primary","db_duration_s":0.002619,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2244gitlab # [ 244.894873] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:10.243Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"7c81150cd6373aedd189c359","created_at":"2026-08-23T07:14:09.915Z","trace_propagation_headers":{"sentry-trace":"ddc3e3c9b57a4e83a82d209535745682-7bec41371ac24be5","baggage":"sentry-trace_id=ddc3e3c9b57a4e83a82d209535745682,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQGF5Z5FF94K7VS7J0MT26","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:09.917Z","job_size_bytes":65,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-7c81150cd6373aedd189c359: start","job_status":"start","queue_duration_s":0.326354,"scheduling_latency_s":0.326367}2245gitlab # [ 244.895608] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:10.274Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"7c81150cd6373aedd189c359","created_at":"2026-08-23T07:14:09.915Z","trace_propagation_headers":{"sentry-trace":"ddc3e3c9b57a4e83a82d209535745682-7bec41371ac24be5","baggage":"sentry-trace_id=ddc3e3c9b57a4e83a82d209535745682,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQGF5Z5FF94K7VS7J0MT26","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:09.917Z","job_size_bytes":65,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-7c81150cd6373aedd189c359: done: 0.03025 sec","job_status":"done","queue_duration_s":0.326354,"scheduling_latency_s":0.326367,"redis_calls":10,"redis_duration_s":0.00122,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000627,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.000593,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020905,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03025,"completed_at":"2026-08-23T07:14:10.273Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007557,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2246gitlab # [ 244.931655] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:10.274Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"937400e489d814d2553e5ff2","created_at":"2026-08-23T07:14:09.945Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-85dec7d89f1b4d6f","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:09.946Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-937400e489d814d2553e5ff2: start","job_status":"start","queue_duration_s":0.328689,"scheduling_latency_s":0.328703}2247gitlab # [ 244.932410] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:10.291Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"937400e489d814d2553e5ff2","created_at":"2026-08-23T07:14:09.945Z","trace_propagation_headers":{"sentry-trace":"e4f2d522d48442a9863590829470fd1c-85dec7d89f1b4d6f","baggage":"sentry-trace_id=e4f2d522d48442a9863590829470fd1c,sentry-release=Unknown"},"correlation_id":"01M0PQEXH0ES8SKGJ91J3Y2W5D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:09.946Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-937400e489d814d2553e5ff2: done: 0.016619 sec","job_status":"done","queue_duration_s":0.328689,"scheduling_latency_s":0.328703,"redis_calls":8,"redis_duration_s":0.001006,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000739,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000267,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011074,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016619,"completed_at":"2026-08-23T07:14:10.291Z","load_balancing_strategy":"primary","db_duration_s":0.002429,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2248gitlab # [ 244.968502] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:10.292Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"ab82d1ced585a8294e8bc9fa","created_at":"2026-08-23T07:14:09.966Z","trace_propagation_headers":{"sentry-trace":"ddc3e3c9b57a4e83a82d209535745682-7bec41371ac24be5","baggage":"sentry-trace_id=ddc3e3c9b57a4e83a82d209535745682,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQGF5Z5FF94K7VS7J0MT26","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:09.968Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-ab82d1ced585a8294e8bc9fa: start","job_status":"start","queue_duration_s":0.323807,"scheduling_latency_s":0.32382}2249gitlab # [ 245.003147] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:10.372Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"ab82d1ced585a8294e8bc9fa","created_at":"2026-08-23T07:14:09.966Z","trace_propagation_headers":{"sentry-trace":"ddc3e3c9b57a4e83a82d209535745682-7bec41371ac24be5","baggage":"sentry-trace_id=ddc3e3c9b57a4e83a82d209535745682,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQGF5Z5FF94K7VS7J0MT26","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:09.968Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-ab82d1ced585a8294e8bc9fa: done: 0.080065 sec","job_status":"done","queue_duration_s":0.323807,"scheduling_latency_s":0.32382,"gitaly_calls":2,"gitaly_duration_s":0.00454,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.004123,"redis_read_bytes":79,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000603,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000708,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000172,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000971,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000139,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000362,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000565,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.058554,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.059336871,"duration_s":0.080065,"completed_at":"2026-08-23T07:14:10.372Z","load_balancing_strategy":"primary","db_duration_s":0.016467,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2250gitlab # [ 245.045155] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:10.373Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"448a3846abb063bcc9ce9761","created_at":"2026-08-23T07:14:09.978Z","trace_propagation_headers":{"sentry-trace":"dff9013c1bde4a7d87809bf40878def6-23e91083c408426b","baggage":"sentry-trace_id=dff9013c1bde4a7d87809bf40878def6,sentry-release=Unknown"},"correlation_id":"01M0PQERPD61XC06C394QS1VT8","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:09.982Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-448a3846abb063bcc9ce9761: start","job_status":"start","queue_duration_s":0.391541,"scheduling_latency_s":0.391556}2251gitlab # [ 245.045679] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:10.430Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"448a3846abb063bcc9ce9761","created_at":"2026-08-23T07:14:09.978Z","trace_propagation_headers":{"sentry-trace":"dff9013c1bde4a7d87809bf40878def6-23e91083c408426b","baggage":"sentry-trace_id=dff9013c1bde4a7d87809bf40878def6,sentry-release=Unknown"},"correlation_id":"01M0PQERPD61XC06C394QS1VT8","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:09.982Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-448a3846abb063bcc9ce9761: done: 0.057293 sec","job_status":"done","queue_duration_s":0.391541,"scheduling_latency_s":0.391556,"redis_calls":11,"redis_duration_s":0.0014759999999999999,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000251,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000935,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00029,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040332,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000200025,"duration_s":0.057293,"completed_at":"2026-08-23T07:14:10.430Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013037,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2252gitlab # [ 245.079939] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:10.431Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"48410761c345a2da1e44afb9","created_at":"2026-08-23T07:14:10.329Z","trace_propagation_headers":{"sentry-trace":"ddc3e3c9b57a4e83a82d209535745682-624d0b194c714e26","baggage":"sentry-trace_id=ddc3e3c9b57a4e83a82d209535745682,sentry-release=Unknown"},"correlation_id":"01M0PQGF5Z5FF94K7VS7J0MT26","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:10.330Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-48410761c345a2da1e44afb9: start","job_status":"start","queue_duration_s":0.1009,"scheduling_latency_s":0.100914}2253gitlab # [ 245.080515] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:10.452Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"48410761c345a2da1e44afb9","created_at":"2026-08-23T07:14:10.329Z","trace_propagation_headers":{"sentry-trace":"ddc3e3c9b57a4e83a82d209535745682-624d0b194c714e26","baggage":"sentry-trace_id=ddc3e3c9b57a4e83a82d209535745682,sentry-release=Unknown"},"correlation_id":"01M0PQGF5Z5FF94K7VS7J0MT26","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:10.330Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-48410761c345a2da1e44afb9: done: 0.02029 sec","job_status":"done","queue_duration_s":0.1009,"scheduling_latency_s":0.100914,"redis_calls":7,"redis_duration_s":0.00086,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000629,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000231,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014821,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02029,"completed_at":"2026-08-23T07:14:10.452Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002965,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2254gitlab # [ 245.169337] nixbot[2596]: INFO: ::ffff:127.0.0.1:52964 - "GET /api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 200 OK2255gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=980b228ea51cf3fdbab6e682314494429da25dba', in 1.13 seconds)2256gitlab # [ 245.197082] nix-daemon[2805]: accepted connection from pid 3383, user nixbot2257(finished: subtest: push delivers the webhook, in 53.71 seconds)2258subtest: eval and build post commit statuses2259gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/980b228ea51cf3fdbab6e682314494429da25dba/statuses2260gitlab # [ 245.253535] gitaly[923]: time="2026-08-23T07:14:11.276Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQGGN6EXR55125DZ244R8G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:14:41.275" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:14:11.276" grpc.time_ms=0.53 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2261gitlab # [ 245.257671] nix-daemon[2805]: accepted connection from pid 3396, user nixbot2262gitlab # [ 245.266975] nix-daemon[2805]: accepted connection from pid 3383, user nixbot2263gitlab # [ 245.308669] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:14:11 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/980b228ea51cf3fdbab6e682314494429da25dba/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 912264gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/980b228ea51cf3fdbab6e682314494429da25dba/statuses, in 0.11 seconds)2265gitlab # [ 245.344586] gitaly[923]: time="2026-08-23T07:14:11.367Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQGGR45TM280AR14JX5QTC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:14:41.366" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:14:11.366" grpc.time_ms=0.695 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2266gitlab # [ 245.378492] gitaly[923]: time="2026-08-23T07:14:11.401Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0PQGGR45TM280AR14JX5QTC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:14:21.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:14:11.390" grpc.time_ms=10.774 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2267gitlab # [ 245.430784] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:11.453Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"f8b256fd28e5cbd133a9b926","created_at":"2026-08-23T07:14:11.448Z","trace_propagation_headers":{"sentry-trace":"be2377180333420195f76cf0f1886e0f-254d58338c4e467d","baggage":"sentry-trace_id=be2377180333420195f76cf0f1886e0f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQGGR45TM280AR14JX5QTC","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:11.451Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f8b256fd28e5cbd133a9b926: start","job_status":"start","queue_duration_s":0.001529,"scheduling_latency_s":0.001559}2268gitlab # [ 245.460429] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:14:11 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 1502269gitlab # [ 245.462062] nixbot[2596]: {"ts": "2026-08-23T07:14:11.484Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/980b228ea51cf3fdbab6e682314494429da25dba \"HTTP/1.1 201 Created\""}2270gitlab # [ 245.506221] gitaly[923]: time="2026-08-23T07:14:11.529Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQGGWZ12PSW3MGJ0ZMRB36 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:14:41.128" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:14:11.528" grpc.time_ms=0.705 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2271gitlab # [ 245.538518] gitaly[923]: time="2026-08-23T07:14:11.561Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M0PQGGWZ12PSW3MGJ0ZMRB36 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:14:21.171" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:14:11.551" grpc.time_ms=9.244 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2272gitlab # [ 245.580946] gitaly[923]: time="2026-08-23T07:14:11.604Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQGGR45TM280AR14JX5QTC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3890 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:14:11.603" grpc.time_ms=0.392 pid=923 span.kind=server system=grpc2273gitlab # [ 245.583189] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:14:11 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1182274gitlab # [ 245.584400] nixbot[2596]: {"ts": "2026-08-23T07:14:11.607Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/980b228ea51cf3fdbab6e682314494429da25dba \"HTTP/1.1 201 Created\""}2275gitlab # [ 245.623056] gitaly[923]: time="2026-08-23T07:14:11.646Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQGGR45TM280AR14JX5QTC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3888 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:14:11.644" grpc.time_ms=1.644 pid=923 span.kind=server system=grpc2276gitlab # [ 245.626974] gitaly[923]: time="2026-08-23T07:14:11.650Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQGH13WHK8CS0NVSX3GHM8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:14:41.249" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:14:11.649" grpc.time_ms=0.481 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2277gitlab # [ 245.651274] gitaly[923]: time="2026-08-23T07:14:11.674Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQGH13WHK8CS0NVSX3GHM8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:14:21.098" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:14:11.668" grpc.time_ms=5.669 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2278gitlab # [ 245.663643] gitaly[923]: time="2026-08-23T07:14:11.686Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQGGR45TM280AR14JX5QTC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3890 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:14:11.686" grpc.time_ms=0.362 pid=923 span.kind=server system=grpc2279gitlab # [ 245.673776] gitaly[923]: time="2026-08-23T07:14:11.697Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQGGR45TM280AR14JX5QTC forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T07:14:41.568" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:14:11.569" operations="[repack_refs]" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2280gitlab # [ 245.683156] gitaly[923]: time="2026-08-23T07:14:11.706Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQGGR45TM280AR14JX5QTC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T07:14:41.568" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:14:11.569" pid=923 remote_ip="2001:db8:1::1" repository_info="{false {6 702 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-08-23 07:13:12.433815031 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2281gitlab # [ 245.687868] gitaly[923]: time="2026-08-23T07:14:11.711Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQGGR45TM280AR14JX5QTC diskcache=1026fbd5-f9e4-4892-89c5-3f21fa11aaaa grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T07:14:41.568" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:14:11.569" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2282gitlab # [ 245.688566] gitaly[923]: time="2026-08-23T07:14:11.711Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=90 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7355 command.oublock=0 command.real_time_ms=126 command.spawn_token_fork_ms=0 command.system_time_ms=63 command.user_time_ms=27 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQGGR45TM280AR14JX5QTC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T07:14:41.568" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:14:11.569" grpc.time_ms=142.19 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2283gitlab # [ 245.698409] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:14:11 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/980b228ea51cf3fdbab6e682314494429da25dba HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1022284gitlab # [ 245.699284] nixbot[2596]: {"ts": "2026-08-23T07:14:11.722Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/980b228ea51cf3fdbab6e682314494429da25dba \"HTTP/1.1 201 Created\""}2285gitlab # [ 245.730262] gitaly[923]: time="2026-08-23T07:14:11.753Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQGGR45TM280AR14JX5QTC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T07:14:41.568" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:14:11.569" pid=923 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2286gitlab # [ 245.734824] gitaly[923]: time="2026-08-23T07:14:11.758Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQGGR45TM280AR14JX5QTC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-23T07:14:41.757" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:14:11.757" grpc.time_ms=0.472 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2287gitlab # [ 245.751376] gitaly[923]: time="2026-08-23T07:14:11.774Z" level=info msg="optimized repository" clean_stale_data_time=46.881377ms clean_work_trees_time="77.384µs" commit_graph_time="3.352µs" correlation_id=01M0PQGGR45TM280AR14JX5QTC gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="3.632µs" pid=923 prune_time="3.631µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="21.512µs" storage_name=default system=housekeeping total_time=67.863933ms2288gitlab # [ 245.752080] gitaly[923]: time="2026-08-23T07:14:11.774Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQGGR45TM280AR14JX5QTC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T07:14:41.568" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:14:11.569" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2289gitlab # [ 245.756335] nix-daemon[2805]: accepted connection from pid 3446, user nixbot2290gitlab # [ 245.779079] gitaly[923]: time="2026-08-23T07:14:11.802Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQGGR45TM280AR14JX5QTC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:14:41.801" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:14:11.801" grpc.time_ms=0.476 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2291gitlab # [ 245.786585] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:11.809Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"f7020c72c9bd92e24b8cb652","created_at":"2026-08-23T07:14:11.808Z","trace_propagation_headers":{"sentry-trace":"be2377180333420195f76cf0f1886e0f-4d0a80ec2b074cf1","baggage":"sentry-trace_id=be2377180333420195f76cf0f1886e0f,sentry-release=Unknown"},"correlation_id":"01M0PQGGR45TM280AR14JX5QTC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"f8b256fd28e5cbd133a9b926","job_size_bytes":3,"pid":2577,"job_status":"deduplicated","message":"PipelineProcessWorker JID-f7020c72c9bd92e24b8cb652: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2292gitlab # [ 245.789080] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:11.812Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"f8b256fd28e5cbd133a9b926","created_at":"2026-08-23T07:14:11.448Z","trace_propagation_headers":{"sentry-trace":"be2377180333420195f76cf0f1886e0f-254d58338c4e467d","baggage":"sentry-trace_id=be2377180333420195f76cf0f1886e0f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQGGR45TM280AR14JX5QTC","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:11.451Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2577,"job_status":"rescheduled","message":"PipelineProcessWorker JID-f8b256fd28e5cbd133a9b926: rescheduled"}2293gitlab # [ 245.793699] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:11.816Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"f8b256fd28e5cbd133a9b926","created_at":"2026-08-23T07:14:11.448Z","trace_propagation_headers":{"sentry-trace":"be2377180333420195f76cf0f1886e0f-254d58338c4e467d","baggage":"sentry-trace_id=be2377180333420195f76cf0f1886e0f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQGGR45TM280AR14JX5QTC","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:11.451Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f8b256fd28e5cbd133a9b926: done: 0.363885 sec","job_status":"done","queue_duration_s":0.001529,"scheduling_latency_s":0.001559,"gitaly_calls":3,"gitaly_duration_s":0.149189,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.016659,"redis_read_bytes":239,"redis_write_bytes":21784,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001466,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000901,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.003087,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14469,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.005625,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000472,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00033,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.003312,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.076,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.008,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.012,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.05,"db_ci_duration_s":0.027,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.117004,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.330721921,"duration_s":0.363885,"completed_at":"2026-08-23T07:14:11.816Z","load_balancing_strategy":"primary","db_duration_s":0.080642,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2294gitlab # [ 245.819786] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:11.818Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"cf8ef0876cf83a3cf34bd61c","created_at":"2026-08-23T07:14:11.562Z","trace_propagation_headers":{"sentry-trace":"be2377180333420195f76cf0f1886e0f-4d0a80ec2b074cf1","baggage":"sentry-trace_id=be2377180333420195f76cf0f1886e0f,sentry-release=Unknown"},"correlation_id":"01M0PQGGR45TM280AR14JX5QTC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:11.564Z","job_size_bytes":23,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-cf8ef0876cf83a3cf34bd61c: start","job_status":"start","queue_duration_s":0.253765,"scheduling_latency_s":0.253781}2295gitlab # [ 245.833030] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:11.850Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"cf8ef0876cf83a3cf34bd61c","created_at":"2026-08-23T07:14:11.562Z","trace_propagation_headers":{"sentry-trace":"be2377180333420195f76cf0f1886e0f-4d0a80ec2b074cf1","baggage":"sentry-trace_id=be2377180333420195f76cf0f1886e0f,sentry-release=Unknown"},"correlation_id":"01M0PQGGR45TM280AR14JX5QTC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:11.564Z","job_size_bytes":23,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-cf8ef0876cf83a3cf34bd61c: done: 0.032891 sec","job_status":"done","queue_duration_s":0.253765,"scheduling_latency_s":0.253781,"redis_calls":7,"redis_duration_s":0.00196,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001547,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000413,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018046,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032891,"completed_at":"2026-08-23T07:14:11.850Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011458,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2296gitlab # [ 245.881245] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:11.851Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"f8f3f5ccd152b70596f1dce8","created_at":"2026-08-23T07:14:11.716Z","trace_propagation_headers":{"sentry-trace":"be2377180333420195f76cf0f1886e0f-4d0a80ec2b074cf1","baggage":"sentry-trace_id=be2377180333420195f76cf0f1886e0f,sentry-release=Unknown"},"correlation_id":"01M0PQGGR45TM280AR14JX5QTC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:11.718Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-f8f3f5ccd152b70596f1dce8: start","job_status":"start","queue_duration_s":0.133329,"scheduling_latency_s":0.133344}2297gitlab # [ 245.881846] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:11.869Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"f8f3f5ccd152b70596f1dce8","created_at":"2026-08-23T07:14:11.716Z","trace_propagation_headers":{"sentry-trace":"be2377180333420195f76cf0f1886e0f-4d0a80ec2b074cf1","baggage":"sentry-trace_id=be2377180333420195f76cf0f1886e0f,sentry-release=Unknown"},"correlation_id":"01M0PQGGR45TM280AR14JX5QTC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:11.718Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-f8f3f5ccd152b70596f1dce8: done: 0.017356 sec","job_status":"done","queue_duration_s":0.133329,"scheduling_latency_s":0.133344,"redis_calls":7,"redis_duration_s":0.00091,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000648,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000262,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010421,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017356,"completed_at":"2026-08-23T07:14:11.869Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0043,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2298gitlab # [ 245.933257] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:11.870Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"621c06e288b8940091d608ab","created_at":"2026-08-23T07:14:11.725Z","trace_propagation_headers":{"sentry-trace":"be2377180333420195f76cf0f1886e0f-4d0a80ec2b074cf1","baggage":"sentry-trace_id=be2377180333420195f76cf0f1886e0f,sentry-release=Unknown"},"correlation_id":"01M0PQGGR45TM280AR14JX5QTC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:11.727Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-621c06e288b8940091d608ab: start","job_status":"start","queue_duration_s":0.142952,"scheduling_latency_s":0.142965}2299gitlab # [ 245.933965] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:11.885Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"621c06e288b8940091d608ab","created_at":"2026-08-23T07:14:11.725Z","trace_propagation_headers":{"sentry-trace":"be2377180333420195f76cf0f1886e0f-4d0a80ec2b074cf1","baggage":"sentry-trace_id=be2377180333420195f76cf0f1886e0f,sentry-release=Unknown"},"correlation_id":"01M0PQGGR45TM280AR14JX5QTC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:11.727Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-621c06e288b8940091d608ab: done: 0.01562 sec","job_status":"done","queue_duration_s":0.142952,"scheduling_latency_s":0.142965,"redis_calls":7,"redis_duration_s":0.000847,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00061,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000237,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010717,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01562,"completed_at":"2026-08-23T07:14:11.885Z","load_balancing_strategy":"primary","db_duration_s":0.002522,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2300gitlab # [ 245.981460] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:11.886Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"b332119eecb232610d2fb30c","created_at":"2026-08-23T07:14:11.731Z","trace_propagation_headers":{"sentry-trace":"be2377180333420195f76cf0f1886e0f-4d0a80ec2b074cf1","baggage":"sentry-trace_id=be2377180333420195f76cf0f1886e0f,sentry-release=Unknown"},"correlation_id":"01M0PQGGR45TM280AR14JX5QTC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:11.733Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-b332119eecb232610d2fb30c: start","job_status":"start","queue_duration_s":0.152757,"scheduling_latency_s":0.15277}2301gitlab # [ 245.982211] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:11.903Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"b332119eecb232610d2fb30c","created_at":"2026-08-23T07:14:11.731Z","trace_propagation_headers":{"sentry-trace":"be2377180333420195f76cf0f1886e0f-4d0a80ec2b074cf1","baggage":"sentry-trace_id=be2377180333420195f76cf0f1886e0f,sentry-release=Unknown"},"correlation_id":"01M0PQGGR45TM280AR14JX5QTC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:11.733Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-b332119eecb232610d2fb30c: done: 0.017102 sec","job_status":"done","queue_duration_s":0.152757,"scheduling_latency_s":0.15277,"redis_calls":10,"redis_duration_s":0.001207,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000638,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000333,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000236,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011975,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017102,"completed_at":"2026-08-23T07:14:11.903Z","load_balancing_strategy":"primary","db_duration_s":0.002557,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2302gitlab # [ 246.021843] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:11.904Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"8c5e5ad6dcd178a07c8eb6e1","created_at":"2026-08-23T07:14:11.734Z","trace_propagation_headers":{"sentry-trace":"be2377180333420195f76cf0f1886e0f-4d0a80ec2b074cf1","baggage":"sentry-trace_id=be2377180333420195f76cf0f1886e0f,sentry-release=Unknown"},"correlation_id":"01M0PQGGR45TM280AR14JX5QTC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:11.735Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-8c5e5ad6dcd178a07c8eb6e1: start","job_status":"start","queue_duration_s":0.169153,"scheduling_latency_s":0.169194}2303gitlab # [ 246.022660] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:11.918Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"8c5e5ad6dcd178a07c8eb6e1","created_at":"2026-08-23T07:14:11.734Z","trace_propagation_headers":{"sentry-trace":"be2377180333420195f76cf0f1886e0f-4d0a80ec2b074cf1","baggage":"sentry-trace_id=be2377180333420195f76cf0f1886e0f,sentry-release=Unknown"},"correlation_id":"01M0PQGGR45TM280AR14JX5QTC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:11.735Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-8c5e5ad6dcd178a07c8eb6e1: done: 0.01435 sec","job_status":"done","queue_duration_s":0.169153,"scheduling_latency_s":0.169194,"redis_calls":7,"redis_duration_s":0.0009029999999999999,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000672,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000231,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009689,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01435,"completed_at":"2026-08-23T07:14:11.918Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002263,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2304gitlab # [ 246.087210] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:11.919Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"0e017729ff3fc5b31bba46bf","created_at":"2026-08-23T07:14:11.735Z","trace_propagation_headers":{"sentry-trace":"be2377180333420195f76cf0f1886e0f-4d0a80ec2b074cf1","baggage":"sentry-trace_id=be2377180333420195f76cf0f1886e0f,sentry-release=Unknown"},"correlation_id":"01M0PQGGR45TM280AR14JX5QTC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:11.736Z","job_size_bytes":19,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-0e017729ff3fc5b31bba46bf: start","job_status":"start","queue_duration_s":0.182657,"scheduling_latency_s":0.18267}2305gitlab # [ 246.087845] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:11.935Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"0e017729ff3fc5b31bba46bf","created_at":"2026-08-23T07:14:11.735Z","trace_propagation_headers":{"sentry-trace":"be2377180333420195f76cf0f1886e0f-4d0a80ec2b074cf1","baggage":"sentry-trace_id=be2377180333420195f76cf0f1886e0f,sentry-release=Unknown"},"correlation_id":"01M0PQGGR45TM280AR14JX5QTC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:11.736Z","job_size_bytes":19,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-0e017729ff3fc5b31bba46bf: done: 0.016038 sec","job_status":"done","queue_duration_s":0.182657,"scheduling_latency_s":0.18267,"redis_calls":8,"redis_duration_s":0.000984,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000742,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000242,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008857,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016038,"completed_at":"2026-08-23T07:14:11.935Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002092,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2306gitlab # [ 246.130134] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:11.936Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"b706491a9ff4155fbe101558","created_at":"2026-08-23T07:14:11.737Z","trace_propagation_headers":{"sentry-trace":"be2377180333420195f76cf0f1886e0f-4d0a80ec2b074cf1","baggage":"sentry-trace_id=be2377180333420195f76cf0f1886e0f,sentry-release=Unknown"},"correlation_id":"01M0PQGGR45TM280AR14JX5QTC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:11.738Z","job_size_bytes":66,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-b706491a9ff4155fbe101558: start","job_status":"start","queue_duration_s":0.197812,"scheduling_latency_s":0.197826}2307gitlab # [ 246.130723] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:11.949Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"b706491a9ff4155fbe101558","created_at":"2026-08-23T07:14:11.737Z","trace_propagation_headers":{"sentry-trace":"be2377180333420195f76cf0f1886e0f-4d0a80ec2b074cf1","baggage":"sentry-trace_id=be2377180333420195f76cf0f1886e0f,sentry-release=Unknown"},"correlation_id":"01M0PQGGR45TM280AR14JX5QTC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:11.738Z","job_size_bytes":66,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-b706491a9ff4155fbe101558: done: 0.012556 sec","job_status":"done","queue_duration_s":0.197812,"scheduling_latency_s":0.197826,"redis_calls":7,"redis_duration_s":0.000869,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00062,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000249,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008602,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012556,"completed_at":"2026-08-23T07:14:11.949Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00143,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2308gitlab # [ 246.180486] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:11.949Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"f6102dbaccb1abc4048ff03d","created_at":"2026-08-23T07:14:11.739Z","trace_propagation_headers":{"sentry-trace":"be2377180333420195f76cf0f1886e0f-4d0a80ec2b074cf1","baggage":"sentry-trace_id=be2377180333420195f76cf0f1886e0f,sentry-release=Unknown"},"correlation_id":"01M0PQGGR45TM280AR14JX5QTC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:11.740Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-f6102dbaccb1abc4048ff03d: start","job_status":"start","queue_duration_s":0.209358,"scheduling_latency_s":0.209372}2309gitlab # [ 246.181246] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:11.968Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"f6102dbaccb1abc4048ff03d","created_at":"2026-08-23T07:14:11.739Z","trace_propagation_headers":{"sentry-trace":"be2377180333420195f76cf0f1886e0f-4d0a80ec2b074cf1","baggage":"sentry-trace_id=be2377180333420195f76cf0f1886e0f,sentry-release=Unknown"},"correlation_id":"01M0PQGGR45TM280AR14JX5QTC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:11.740Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-f6102dbaccb1abc4048ff03d: done: 0.018732 sec","job_status":"done","queue_duration_s":0.209358,"scheduling_latency_s":0.209372,"redis_calls":7,"redis_duration_s":0.000866,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00062,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000246,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013797,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018732,"completed_at":"2026-08-23T07:14:11.968Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002628,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2310gitlab # [ 246.199572] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:11.969Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"3aaef00c22620199a03310b7","created_at":"2026-08-23T07:14:11.745Z","trace_propagation_headers":{"sentry-trace":"be2377180333420195f76cf0f1886e0f-4d0a80ec2b074cf1","baggage":"sentry-trace_id=be2377180333420195f76cf0f1886e0f,sentry-release=Unknown"},"correlation_id":"01M0PQGGR45TM280AR14JX5QTC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:11.746Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-3aaef00c22620199a03310b7: start","job_status":"start","queue_duration_s":0.223115,"scheduling_latency_s":0.223129}2311gitlab # [ 246.235060] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:11.984Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"3aaef00c22620199a03310b7","created_at":"2026-08-23T07:14:11.745Z","trace_propagation_headers":{"sentry-trace":"be2377180333420195f76cf0f1886e0f-4d0a80ec2b074cf1","baggage":"sentry-trace_id=be2377180333420195f76cf0f1886e0f,sentry-release=Unknown"},"correlation_id":"01M0PQGGR45TM280AR14JX5QTC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:11.746Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-3aaef00c22620199a03310b7: done: 0.014845 sec","job_status":"done","queue_duration_s":0.223115,"scheduling_latency_s":0.223129,"redis_calls":7,"redis_duration_s":0.0009029999999999999,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000664,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000239,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009253,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014845,"completed_at":"2026-08-23T07:14:11.984Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003187,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2312gitlab # [ 246.246490] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:11.985Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"0765868761a041efe56765fa","created_at":"2026-08-23T07:14:11.746Z","trace_propagation_headers":{"sentry-trace":"be2377180333420195f76cf0f1886e0f-4d0a80ec2b074cf1","baggage":"sentry-trace_id=be2377180333420195f76cf0f1886e0f,sentry-release=Unknown"},"correlation_id":"01M0PQGGR45TM280AR14JX5QTC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:11.747Z","job_size_bytes":6,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-0765868761a041efe56765fa: start","job_status":"start","queue_duration_s":0.237541,"scheduling_latency_s":0.237555}2313gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/980b228ea51cf3fdbab6e682314494429da25dba/statuses2314gitlab # [ 246.259430] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:11.993Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"0765868761a041efe56765fa","created_at":"2026-08-23T07:14:11.746Z","trace_propagation_headers":{"sentry-trace":"be2377180333420195f76cf0f1886e0f-4d0a80ec2b074cf1","baggage":"sentry-trace_id=be2377180333420195f76cf0f1886e0f,sentry-release=Unknown"},"correlation_id":"01M0PQGGR45TM280AR14JX5QTC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:11.747Z","job_size_bytes":6,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-0765868761a041efe56765fa: done: 0.008088 sec","job_status":"done","queue_duration_s":0.237541,"scheduling_latency_s":0.237555,"redis_calls":7,"redis_duration_s":0.000817,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000594,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000223,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005225,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008088,"completed_at":"2026-08-23T07:14:11.993Z","load_balancing_strategy":"primary","db_duration_s":0.000236,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2315gitlab # [ 246.302189] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:11.994Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"7ee76c777428999f96bd6b4f","created_at":"2026-08-23T07:14:11.747Z","trace_propagation_headers":{"sentry-trace":"be2377180333420195f76cf0f1886e0f-4d0a80ec2b074cf1","baggage":"sentry-trace_id=be2377180333420195f76cf0f1886e0f,sentry-release=Unknown"},"correlation_id":"01M0PQGGR45TM280AR14JX5QTC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:11.749Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-7ee76c777428999f96bd6b4f: start","job_status":"start","queue_duration_s":0.245026,"scheduling_latency_s":0.245039}2316gitlab # [ 246.304585] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:12.007Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"7ee76c777428999f96bd6b4f","created_at":"2026-08-23T07:14:11.747Z","trace_propagation_headers":{"sentry-trace":"be2377180333420195f76cf0f1886e0f-4d0a80ec2b074cf1","baggage":"sentry-trace_id=be2377180333420195f76cf0f1886e0f,sentry-release=Unknown"},"correlation_id":"01M0PQGGR45TM280AR14JX5QTC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:11.749Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-7ee76c777428999f96bd6b4f: done: 0.013184 sec","job_status":"done","queue_duration_s":0.245026,"scheduling_latency_s":0.245039,"redis_calls":7,"redis_duration_s":0.001006,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000783,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000223,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008839,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013184,"completed_at":"2026-08-23T07:14:12.007Z","load_balancing_strategy":"primary","db_duration_s":0.001788,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2317gitlab # [ 246.358555] sidekiq-cluster[2577]: {"severity":"INFO","time":"2026-08-23T07:14:12.008Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"d6274dcd0682eff4db5b8c8a","created_at":"2026-08-23T07:14:11.812Z","trace_propagation_headers":{"sentry-trace":"be2377180333420195f76cf0f1886e0f-4d0a80ec2b074cf1","baggage":"sentry-trace_id=be2377180333420195f76cf0f1886e0f,sentry-release=Unknown"},"correlation_id":"01M0PQGGR45TM280AR14JX5QTC","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:11.813Z","job_size_bytes":3,"pid":2577,"sidekiq_tid":"m81x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d6274dcd0682eff4db5b8c8a: start","job_status":"start","queue_duration_s":0.194779,"scheduling_latency_s":0.194792}2318gitlab # [ 246.392098] gitaly[923]: time="2026-08-23T07:14:12.415Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0PQGH706YM41NK948Q2CPK6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:14:12.409" grpc.time_ms=5.732 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc2319gitlab # [ 246.393811] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:14:12 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 6072320gitlab # [ 246.407742] gitaly[923]: time="2026-08-23T07:14:12.431Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQGHRJKVNA40X66E4FYHVF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:14:42.030" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:14:12.430" grpc.time_ms=0.395 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2321gitlab # [ 246.408748] gitaly[923]: time="2026-08-23T07:14:12.432Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQGGR45TM280AR14JX5QTC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3890 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:14:12.431" grpc.time_ms=0.296 pid=923 span.kind=server system=grpc2322gitlab # [ 246.428062] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:14:12 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/980b228ea51cf3fdbab6e682314494429da25dba/statuses HTTP/1.1" 200 1316 "" "curl/8.21.0" 792323gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/980b228ea51cf3fdbab6e682314494429da25dba/statuses, in 0.12 seconds)2324(finished: subtest: eval and build post commit statuses, in 1.24 seconds)2325(finished: run the VM test script, in 296.37 seconds)2326gitlab # [ 246.445150] gitaly[923]: time="2026-08-23T07:14:12.468Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQGHT2BXBRSWDCA27DJ1JG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:14:12.461" pid=923 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2327gitlab # [ 246.445753] gitaly[923]: time="2026-08-23T07:14:12.468Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQGHT2BXBRSWDCA27DJ1JG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:14:12.461" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc2328gitlab # [ 246.446459] gitlab-workhorse[825]: time="2026-08-23T07:14:12Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672329gitlab # [ 246.446948] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/23:07:14:12 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 502330gitlab # [ 246.447560] gitaly[923]: time="2026-08-23T07:14:12.468Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQGHT2BXBRSWDCA27DJ1JG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:14:12.461" grpc.time_ms=7.008 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc2331gitlab # [ 246.479887] gitaly[923]: time="2026-08-23T07:14:12.503Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQGGR45TM280AR14JX5QTC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3888 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:14:12.502" grpc.time_ms=0.295 pid=923 span.kind=server system=grpc2332test script finished in 296.44s2333cleanup2334kill QemuMachine (pid 46)2335gitlab # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14)2336(finished: cleanup, in 1.55 seconds)2337additionally exposed symbols:2338 gitlab,2339 vlan1,2340 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2341[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-23T07:13:17.079Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2342[]2343[]2344[]2345[]2346[]2347[]2348[]2349[]2350[]2351[]2352[]2353[]2354[]2355[]2356[]2357[]2358[]2359[]2360[]2361[]2362[]2363[]2364[]2365[]2366[]2367[]2368[]2369[]2370[]2371[]2372[]2373[]2374[]2375[]2376[]2377[]2378[]2379[]2380[]2381[]2382[]2383[]2384[]2385[]2386[]2387[]2388[]2389[]2390[]2391[]2392[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '980b228ea51cf3fdbab6e682314494429da25dba', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-23T07:14:09.722349Z', 'started_at': '2026-08-23T07:14:09.980078Z', 'finished_at': None}]2393[{'id': 5, 'sha': '980b228ea51cf3fdbab6e682314494429da25dba', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-23T07:14:09.962Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2394[{'id': 5, 'sha': '980b228ea51cf3fdbab6e682314494429da25dba', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded', 'created_at': '2026-08-23T07:14:09.962Z', 'started_at': None, 'finished_at': '2026-08-23T07:14:11.440Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '980b228ea51cf3fdbab6e682314494429da25dba', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-08-23T07:14:11.585Z', 'started_at': None, 'finished_at': '2026-08-23T07:14:11.694Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]