vm-test-run-nixbot-gitlab
checks.x86_64-linux.nixbot-gitlab
· build #355
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.mdNZoAN05V', fmt=raw size=107374182412(finished: start all VMs, in 55.25 seconds)13gitlab # mke2fs 1.47.4 (6-Mar-2025)14gitlab: waiting for unit setup-gitlab.service15gitlab # Discarding device blocks: 0/262144 done16gitlab: waiting for the VM to finish booting17gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes18gitlab # Filesystem UUID: 621a1832-77dc-4255-9991-f8f642a8885d19gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 202645gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/glc83l11q2fmszjn3hzi23f1vqm5wy20-nixos-system-gitlab-test/init regInfo=/nix/store/d3inayl53i7g87srk66mbbnp0dnp9mcq-closure-info/registration console=ttyS0,115200n8 console=tty046gitlab # [ 0.000000] BIOS-provided physical RAM map:47gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable48gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved49gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable51gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable55gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved56gitlab # [ 0.000000] NX (Execute Disable) protection: active57gitlab # [ 0.000000] APIC: Static calls initialized58gitlab # [ 0.000000] SMBIOS 2.8 present.59gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201460gitlab # [ 0.000000] DMI: Memory slots populated: 1/161gitlab # [ 0.000000] Hypervisor detected: KVM62gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000063gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0064gitlab # [ 0.000000] kvm-clock: using sched offset of 485648515 cycles65gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns66gitlab # [ 0.000005] tsc: Detected 2400.012 MHz processor67gitlab # [ 0.000834] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000068gitlab # [ 0.000860] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs69gitlab # [ 0.000863] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT70gitlab # [ 0.000901] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000071gitlab # [ 0.002748] found SMP MP-table at [mem 0x000f5470-0x000f547f]72gitlab # [ 0.002763] Using GB pages for direct mapping73gitlab # [ 0.002876] RAMDISK: [mem 0xbe31c000-0xbffcffff]74gitlab # [ 0.002884] ACPI: Early table checksum verification disabled75gitlab # [ 0.002887] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )76gitlab # [ 0.002891] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)77gitlab # [ 0.002895] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002902] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002904] ACPI: FACS 0x00000000BFFE0000 00004080gitlab # [ 0.002905] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)81gitlab # [ 0.002907] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002909] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002910] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]84gitlab # [ 0.002911] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]85gitlab # [ 0.002912] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]86gitlab # [ 0.002912] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]87gitlab # [ 0.002913] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]88gitlab # [ 0.002913] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]89gitlab # [ 0.003133] No NUMA configuration found90gitlab # [ 0.003134] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]91gitlab # [ 0.003136] NODE_DATA(0) allocated [mem 0x1bfff8780-0x1bfffdcff]92gitlab # [ 0.005500] Zone ranges:93gitlab # [ 0.005501] DMA [mem 0x0000000000001000-0x0000000000ffffff]94gitlab # [ 0.005503] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]95gitlab # [ 0.005504] Normal [mem 0x0000000100000000-0x00000001bfffffff]96gitlab # [ 0.005505] Device empty97gitlab # [ 0.005506] Movable zone start for each node98gitlab # [ 0.005506] Early memory node ranges99gitlab # [ 0.005507] node 0: [mem 0x0000000000001000-0x000000000009efff]100gitlab # [ 0.005508] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]101gitlab # [ 0.005509] node 0: [mem 0x0000000100000000-0x00000001bfffffff]102gitlab # [ 0.005510] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]103gitlab # [ 0.005528] On node 0, zone DMA: 1 pages in unavailable ranges104gitlab # [ 0.005808] On node 0, zone DMA: 97 pages in unavailable ranges105gitlab # [ 0.117340] On node 0, zone Normal: 40 pages in unavailable ranges106gitlab # [ 0.117775] ACPI: PM-Timer IO Port: 0x608107gitlab # [ 0.117790] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])108gitlab # [ 0.117829] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23109gitlab # [ 0.117832] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)110gitlab # [ 0.117834] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)111gitlab # [ 0.117836] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)112gitlab # [ 0.117837] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)113gitlab # [ 0.117837] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)114gitlab # [ 0.117840] ACPI: Using ACPI (MADT) for SMP configuration information115gitlab # [ 0.117842] ACPI: HPET id: 0x8086a201 base: 0xfed00000116gitlab # [ 0.117847] TSC deadline timer available117gitlab # [ 0.117852] CPU topo: Max. logical packages: 1118gitlab # [ 0.117853] CPU topo: Max. logical dies: 1119gitlab # [ 0.117853] CPU topo: Max. dies per package: 1120gitlab # [ 0.117856] CPU topo: Max. threads per core: 1121gitlab # [ 0.117857] CPU topo: Num. cores per package: 4122gitlab # [ 0.117858] CPU topo: Num. threads per package: 4123gitlab # [ 0.117858] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs124gitlab # [ 0.117885] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()125gitlab # [ 0.117903] kvm-guest: KVM setup pv remote TLB flush126gitlab # [ 0.117906] kvm-guest: setup PV sched yield127gitlab # [ 0.117924] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]128gitlab # [ 0.117926] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]129gitlab # [ 0.117927] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]130gitlab # [ 0.117928] [mem 0xc0000000-0xfeffbfff] available for PCI devices131gitlab # [ 0.117930] Booting paravirtualized kernel on KVM132gitlab # [ 0.117934] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns133gitlab # [ 0.122373] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1134gitlab # [ 0.124672] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288135gitlab # [ 0.124727] kvm-guest: PV spinlocks enabled136gitlab # [ 0.124729] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)137gitlab # [ 0.124732] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/glc83l11q2fmszjn3hzi23f1vqm5wy20-nixos-system-gitlab-test/init regInfo=/nix/store/d3inayl53i7g87srk66mbbnp0dnp9mcq-closure-info/registration console=ttyS0,115200n8 console=tty0138gitlab # [ 0.124839] Unknown kernel command line parameters "regInfo=/nix/store/d3inayl53i7g87srk66mbbnp0dnp9mcq-closure-info/registration", will be passed to user space.139gitlab # [ 0.124852] random: crng init done140gitlab # [ 0.124853] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes141gitlab # [ 0.134029] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)142gitlab # [ 0.138702] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)143gitlab # [ 0.138788] software IO TLB: area num 4.144gitlab # [ 0.217174] Fallback order for Node 0: 0145gitlab # [ 0.217183] Built 1 zonelists, mobility grouping on. Total pages: 1572726146gitlab # [ 0.217185] Policy zone: Normal147gitlab # [ 0.219806] mem auto-init: stack:all(zero), heap alloc:on, heap free:off148gitlab # [ 0.230304] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1149gitlab # [ 0.244580] allocated 12582912 bytes of page_ext150gitlab # [ 0.254854] ftrace: allocating 48717 entries in 192 pages151gitlab # [ 0.254856] ftrace: allocated 192 pages with 2 groups152gitlab # [ 0.255778] Dynamic Preempt: lazy153gitlab # [ 0.255954] rcu: Preemptible hierarchical RCU implementation.154gitlab # [ 0.255955] rcu: RCU event tracing is enabled.155gitlab # [ 0.255955] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.156gitlab # [ 0.255957] Trampoline variant of Tasks RCU enabled.157gitlab # [ 0.255958] Rude variant of Tasks RCU enabled.158gitlab # [ 0.255958] Tracing variant of Tasks RCU enabled.159gitlab # [ 0.255959] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.160gitlab # [ 0.255959] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4161gitlab # [ 0.255987] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.162gitlab # [ 0.255989] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.255990] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.260422] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16165gitlab # [ 0.260749] rcu: srcu_init: Setting srcu_struct sizes based on contention.166gitlab # [ 0.260765] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns167gitlab # [ 0.260883] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)168gitlab # [ 0.264494] Console: colour VGA+ 80x25169gitlab # [ 0.264496] printk: legacy console [tty0] enabled170gitlab # [ 0.294892] printk: legacy console [ttyS0] enabled171gitlab # [ 0.393751] ACPI: Core revision 20250807172gitlab # [ 0.394689] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns173gitlab # [ 0.396182] APIC: Switch to symmetric I/O mode setup174gitlab # [ 0.397178] x2apic enabled175gitlab # [ 0.397955] APIC: Switched APIC routing to: physical x2apic176gitlab # [ 0.398819] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()177gitlab # [ 0.399960] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()178gitlab # [ 0.401416] kvm-guest: setup PV IPIs179gitlab # [ 0.402960] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1180gitlab # [ 0.403968] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns181gitlab # [ 0.405651] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)182gitlab # [ 0.406737] x86/cpu: User Mode Instruction Prevention (UMIP) activated183gitlab # [ 0.408750] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127184gitlab # [ 0.410648] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0185gitlab # [ 0.411652] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto186gitlab # [ 0.413648] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl187gitlab # [ 0.414648] Transient Scheduler Attacks: Vulnerable: No microcode188gitlab # [ 0.416389] Spectre V2 : Mitigation: Enhanced / Automatic IBRS189gitlab # [ 0.417360] Speculative Return Stack Overflow: Mitigation: Safe RET190gitlab # [ 0.417648] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization191gitlab # [ 0.419655] Spectre V2 : Enabling IBPB for BPF192gitlab # [ 0.420389] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier193gitlab # [ 0.421648] active return thunk: srso_alias_return_thunk194gitlab # [ 0.422670] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'195gitlab # [ 0.423648] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'196gitlab # [ 0.424648] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'197gitlab # [ 0.425648] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'198gitlab # [ 0.426648] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'199gitlab # [ 0.427648] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'200gitlab # [ 0.429461] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'201gitlab # [ 0.430648] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256202gitlab # [ 0.431625] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64203gitlab # [ 0.432648] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512204gitlab # [ 0.433648] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024205gitlab # [ 0.434628] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8206gitlab # [ 0.435648] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.207gitlab # [ 0.465672] Freeing SMP alternatives memory: 44K208gitlab # [ 0.466491] pid_max: default: 32768 minimum: 301209gitlab # [ 0.467323] LSM: initializing lsm=capability,landlock,yama,bpf,ima210gitlab # [ 0.467754] landlock: Up and running.211gitlab # [ 0.469099] Yama: becoming mindful.212gitlab # [ 0.469855] LSM support for eBPF active213gitlab # [ 0.470892] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)214gitlab # [ 0.471819] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)215gitlab # [ 0.474937] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)216gitlab # [ 0.476239] Performance Events: Fam17h+ core perfctr, AMD PMU driver.217gitlab # [ 0.476657] ... version: 2218gitlab # [ 0.477416] ... bit width: 48219gitlab # [ 0.477650] ... generic counters: 6220gitlab # [ 0.478355] ... generic bitmap: 000000000000003f221gitlab # [ 0.478651] ... fixed-purpose counters: 0222gitlab # [ 0.479420] ... fixed-purpose bitmap: 0000000000000000223gitlab # [ 0.479650] ... value mask: 0000ffffffffffff224gitlab # [ 0.480553] ... max period: 00007fffffffffff225gitlab # [ 0.481355] ... global_ctrl mask: 000000000000003f226gitlab # [ 0.481769] signal: max sigframe size: 3376227gitlab # [ 0.482530] rcu: Hierarchical SRCU implementation.228gitlab # [ 0.483240] rcu: Max phase no-delay instances is 400.229gitlab # [ 0.483848] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level230gitlab # [ 0.489233] smp: Bringing up secondary CPUs ...231gitlab # [ 0.490105] smpboot: x86: Booting SMP configuration:232gitlab # [ 0.490653] .... node #0, CPUs: #1 #2 #3233gitlab # [ 0.494696] smp: Brought up 1 node, 4 CPUs234gitlab # [ 0.496210] smpboot: Total of 4 processors activated (19200.09 BogoMIPS)235gitlab # [ 0.497009] Memory: 6011556K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260108K reserved, 0K cma-reserved)236gitlab # [ 0.498650] devtmpfs: initialized237gitlab # [ 0.499753] x86/mm: Memory block size: 128MB238gitlab # [ 0.502820] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)239gitlab # [ 0.503732] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).240gitlab # [ 0.504762] pinctrl core: initialized pinctrl subsystem241gitlab # [ 0.505900] PM: RTC time: 05:54:18, date: 2026-09-08242gitlab # [ 0.509840] NET: Registered PF_NETLINK/PF_ROUTE protocol family243gitlab # [ 0.512011] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations244gitlab # [ 0.512715] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations245gitlab # [ 0.514798] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations246gitlab # [ 0.515663] audit: initializing netlink subsys (disabled)247gitlab # [ 0.516679] audit: type=2000 audit(1788846858.092:1): state=initialized audit_enabled=0 res=1248gitlab # [ 0.516906] thermal_sys: Registered thermal governor 'fair_share'249gitlab # [ 0.518651] thermal_sys: Registered thermal governor 'bang_bang'250gitlab # [ 0.519650] thermal_sys: Registered thermal governor 'step_wise'251gitlab # [ 0.520624] thermal_sys: Registered thermal governor 'user_space'252gitlab # [ 0.521427] thermal_sys: Registered thermal governor 'power_allocator'253gitlab # [ 0.521665] cpuidle: using governor menu254gitlab # [ 0.523925] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5255gitlab # [ 0.524889] PCI: Using configuration type 1 for base access256gitlab # [ 0.525651] PCI: Using configuration type 1 for extended access257gitlab # [ 0.526785] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.258gitlab # [ 0.529672] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages259gitlab # [ 0.530651] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page260gitlab # [ 0.531650] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages261gitlab # [ 0.532652] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page262gitlab # [ 0.538418] ACPI: Added _OSI(Module Device)263gitlab # [ 0.540657] ACPI: Added _OSI(Processor Device)264gitlab # [ 0.542660] ACPI: Added _OSI(Processor Aggregator Device)265gitlab # [ 0.549916] ACPI: 1 ACPI AML tables successfully acquired and loaded266gitlab # [ 0.557123] ACPI: Interpreter enabled267gitlab # [ 0.558718] ACPI: PM: (supports S0 S3 S4 S5)268gitlab # [ 0.560659] ACPI: Using IOAPIC for interrupt routing269gitlab # [ 0.562728] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug270gitlab # [ 0.567661] PCI: Using E820 reservations for host bridge windows271gitlab # [ 0.570054] ACPI: Enabled 2 GPEs in block 00 to 0F272gitlab # [ 0.584656] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])273gitlab # [ 0.586664] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]274gitlab # [ 0.590461] acpiphp: Slot [3] registered275gitlab # [ 0.591704] acpiphp: Slot [4] registered276gitlab # [ 0.593693] acpiphp: Slot [5] registered277gitlab # [ 0.594711] acpiphp: Slot [6] registered278gitlab # [ 0.595695] acpiphp: Slot [7] registered279gitlab # [ 0.597693] acpiphp: Slot [8] registered280gitlab # [ 0.598720] acpiphp: Slot [9] registered281gitlab # [ 0.599695] acpiphp: Slot [10] registered282gitlab # [ 0.601694] acpiphp: Slot [11] registered283gitlab # [ 0.602694] acpiphp: Slot [12] registered284gitlab # [ 0.603711] acpiphp: Slot [13] registered285gitlab # [ 0.605693] acpiphp: Slot [14] registered286gitlab # [ 0.606692] acpiphp: Slot [15] registered287gitlab # [ 0.607692] acpiphp: Slot [16] registered288gitlab # [ 0.608681] acpiphp: Slot [17] registered289gitlab # [ 0.609408] acpiphp: Slot [18] registered290gitlab # [ 0.610671] acpiphp: Slot [19] registered291gitlab # [ 0.611475] acpiphp: Slot [20] registered292gitlab # [ 0.612223] acpiphp: Slot [21] registered293gitlab # [ 0.612692] acpiphp: Slot [22] registered294gitlab # [ 0.613417] acpiphp: Slot [23] registered295gitlab # [ 0.614679] acpiphp: Slot [24] registered296gitlab # [ 0.615438] acpiphp: Slot [25] registered297gitlab # [ 0.615671] acpiphp: Slot [26] registered298gitlab # [ 0.616401] acpiphp: Slot [27] registered299gitlab # [ 0.617687] acpiphp: Slot [28] registered300gitlab # [ 0.618436] acpiphp: Slot [29] registered301gitlab # [ 0.618693] acpiphp: Slot [30] registered302gitlab # [ 0.619425] acpiphp: Slot [31] registered303gitlab # [ 0.620669] PCI host bridge to bus 0000:00304gitlab # [ 0.621760] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]305gitlab # [ 0.622655] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]306gitlab # [ 0.623651] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]307gitlab # [ 0.624653] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]308gitlab # [ 0.626651] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]309gitlab # [ 0.627651] pci_bus 0000:00: root bus resource [bus 00-ff]310gitlab # [ 0.628964] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint311gitlab # [ 0.631234] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint312gitlab # [ 0.633094] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint313gitlab # [ 0.636365] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]314gitlab # [ 0.636678] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk315gitlab # [ 0.637651] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk316gitlab # [ 0.638650] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk317gitlab # [ 0.640650] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk318gitlab # [ 0.641845] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint319gitlab # [ 0.644680] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]320gitlab # [ 0.646748] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint321gitlab # [ 0.648925] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI322gitlab # [ 0.649657] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB323gitlab # [ 0.650866] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint324gitlab # [ 0.662715] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]325gitlab # [ 0.664694] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]326gitlab # [ 0.665673] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]327gitlab # [ 0.666902] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]328gitlab # [ 0.669573] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint329gitlab # [ 0.674683] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]330gitlab # [ 0.675619] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]331gitlab # [ 0.676467] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]332gitlab # [ 0.688742] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]333gitlab # [ 0.697121] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint334gitlab # [ 0.708693] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]335gitlab # [ 0.710672] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]336gitlab # [ 0.713711] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]337gitlab # [ 0.719791] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint338gitlab # [ 0.729676] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]339gitlab # [ 0.731672] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]340gitlab # [ 0.734729] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]341gitlab # [ 0.740710] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint342gitlab # [ 0.747671] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]343gitlab # [ 0.749666] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]344gitlab # [ 0.750696] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]345gitlab # [ 0.755577] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint346gitlab # [ 0.766680] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]347gitlab # [ 0.768677] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]348gitlab # [ 0.771716] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]349gitlab # [ 0.778137] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint350gitlab # [ 0.790679] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]351gitlab # [ 0.792676] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]352gitlab # [ 0.795716] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]353gitlab # [ 0.801645] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint354gitlab # [ 0.810686] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]355gitlab # [ 0.812666] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]356gitlab # [ 0.814697] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]357gitlab # [ 0.816674] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]358gitlab # [ 0.821424] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint359gitlab # [ 0.828890] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]360gitlab # [ 0.831710] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]361gitlab # [ 0.837711] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint362gitlab # [ 0.847700] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]363gitlab # [ 0.849672] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]364gitlab # [ 0.851710] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]365gitlab # [ 0.857858] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint366gitlab # [ 0.864684] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]367gitlab # [ 0.866668] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]368gitlab # [ 0.868696] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]369gitlab # [ 0.878084] ACPI: PCI: Interrupt link LNKA configured for IRQ 10370gitlab # [ 0.879803] ACPI: PCI: Interrupt link LNKB configured for IRQ 10371gitlab # [ 0.880802] ACPI: PCI: Interrupt link LNKC configured for IRQ 11372gitlab # [ 0.881782] ACPI: PCI: Interrupt link LNKD configured for IRQ 11373gitlab # [ 0.882725] ACPI: PCI: Interrupt link LNKS configured for IRQ 9374gitlab # [ 0.886700] iommu: Default domain type: Translated375gitlab # [ 0.887281] iommu: DMA domain TLB invalidation policy: lazy mode376gitlab # [ 0.889004] ACPI: bus type USB registered377gitlab # [ 0.889717] usbcore: registered new interface driver usbfs378gitlab # [ 0.890671] usbcore: registered new interface driver hub379gitlab # [ 0.891636] usbcore: registered new device driver usb380gitlab # [ 0.894429] NetLabel: Initializing381gitlab # [ 0.894651] NetLabel: domain hash size = 128382gitlab # [ 0.895442] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO383gitlab # [ 0.896694] NetLabel: unlabeled traffic allowed by default384gitlab # [ 0.897652] PCI: Using ACPI for IRQ routing385gitlab # [ 0.898844] pci 0000:00:02.0: vgaarb: setting as boot VGA device386gitlab # [ 0.899647] pci 0000:00:02.0: vgaarb: bridge control possible387gitlab # [ 0.899647] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none388gitlab # [ 0.902655] vgaarb: loaded389gitlab # [ 0.903418] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0390gitlab # [ 0.904650] hpet0: 3 comparators, 64-bit 100.000000 MHz counter391gitlab # [ 0.909729] clocksource: Switched to clocksource kvm-clock392gitlab # [ 0.911620] VFS: Disk quotas dquot_6.6.0393gitlab # [ 0.912372] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)394gitlab # [ 0.913895] pnp: PnP ACPI init395gitlab # [ 0.915143] pnp: PnP ACPI: found 6 devices396gitlab # [ 0.924627] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns397gitlab # [ 0.926246] clocksource: Switched to clocksource acpi_pm398gitlab # [ 0.927264] NET: Registered PF_INET protocol family399gitlab # [ 0.929467] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)400gitlab # [ 0.947381] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)401gitlab # [ 0.948935] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)402gitlab # [ 0.950371] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)403gitlab # [ 0.954189] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)404gitlab # [ 0.955561] TCP: Hash tables configured (established 65536 bind 65536)405gitlab # [ 0.956778] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)406gitlab # [ 0.958210] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)407gitlab # [ 0.959654] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)408gitlab # [ 0.961070] NET: Registered PF_UNIX/PF_LOCAL protocol family409gitlab # [ 0.962119] NET: Registered PF_XDP protocol family410gitlab # [ 0.963011] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]411gitlab # [ 0.964076] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]412gitlab # [ 0.965139] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]413gitlab # [ 0.966281] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]414gitlab # [ 0.967460] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]415gitlab # [ 0.968842] pci 0000:00:01.0: PIIX3: Enabling Passive Release416gitlab # [ 0.969908] pci 0000:00:00.0: Limiting direct PCI/PCI transfers417gitlab # [ 0.972307] ACPI: \_SB_.LNKD: Enabled at IRQ 11418gitlab # [ 0.975150] PCI: CLS 0 bytes, default 64419gitlab # [ 0.975973] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)420gitlab # [ 0.976572] Trying to unpack rootfs image as initramfs...421gitlab # [ 0.977079] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB)422gitlab # [ 0.977205] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns423gitlab # [ 1.000525] Initialise system trusted keyrings424gitlab # [ 1.001872] workingset: timestamp_bits=40 max_order=21 bucket_order=0425gitlab # [ 1.013497] Key type asymmetric registered426gitlab # [ 1.014251] Asymmetric key parser 'x509' registered427gitlab # [ 1.015182] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)428gitlab # [ 1.016906] io scheduler mq-deadline registered429gitlab # [ 1.017712] io scheduler kyber registered430gitlab # [ 1.022310] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled431gitlab # [ 1.023674] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A432gitlab # [ 1.026329] Linux agpgart interface v0.103433gitlab # [ 1.027126] ACPI: bus type drm_connector registered434gitlab # [ 1.032347] usbcore: registered new interface driver usbserial_generic435gitlab # [ 1.033539] usbserial: USB Serial support registered for generic436gitlab # [ 1.034593] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.437gitlab # [ 1.034593] Please enable it if your BIOS has the CPPC option.438gitlab # [ 1.036963] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled439gitlab # [ 1.038415] drop_monitor: Initializing network drop monitor service440gitlab # [ 1.039605] NET: Registered PF_INET6 protocol family441gitlab # [ 1.041597] Segment Routing with IPv6442gitlab # [ 1.042291] In-situ OAM (IOAM) with IPv6443gitlab # [ 1.045193] IPI shorthand broadcast: enabled444gitlab # [ 1.049580] sched_clock: Marking stable (912020726, 136882886)->(1067760311, -18856699)445gitlab # [ 1.051461] registered taskstats version 1446gitlab # [ 1.052510] Loading compiled-in X.509 certificates447gitlab # [ 1.062165] Demotion targets for Node 0: null448gitlab # [ 1.063238] Key type .fscrypt registered449gitlab # [ 1.063950] Key type fscrypt-provisioning registered450gitlab # [ 1.064936] ima: No TPM chip found, activating TPM-bypass!451gitlab # [ 1.065878] ima: Allocated hash algorithm: sha1452gitlab # [ 1.066735] ima: No architecture policies found453gitlab # [ 1.067949] PM: Magic number: 10:39:921454gitlab # [ 1.069614] RAS: Correctable Errors collector initialized.455gitlab # [ 1.074132] clk: Disabling unused clocks456gitlab # [ 1.074856] PM: genpd: Disabling unused power domains457gitlab # [ 1.262595] Freeing initrd memory: 29392K458gitlab # [ 1.270171] Freeing unused decrypted memory: 2028K459gitlab # [ 1.276446] Freeing unused kernel image (initmem) memory: 3640K460gitlab # [ 1.279153] Write protecting the kernel read-only data: 32768k461gitlab # [ 1.284057] Freeing unused kernel image (text/rodata gap) memory: 1220K462gitlab # [ 1.287989] Freeing unused kernel image (rodata/data gap) memory: 760K463gitlab # [ 1.356285] x86/mm: Checked W+X mappings: passed, no W+X pages found.464gitlab # [ 1.357540] Run /init as init process465gitlab # [ 1.371521] systemd[1]: Inserted module 'autofs4'466gitlab # [ 1.394498] fuse: init (API version 7.45)467gitlab # [ 1.402881] ACPI: \_SB_.LNKC: Enabled at IRQ 10468gitlab # [ 1.410123] ACPI: \_SB_.LNKA: Enabled at IRQ 10469gitlab # [ 1.413322] ACPI: \_SB_.LNKB: Enabled at IRQ 11470gitlab # [ 1.449130] systemd[1]: Successfully made /usr/ read-only.471gitlab # [ 1.784974] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)472gitlab # [ 1.824506] systemd[1]: Detected virtualization kvm.473gitlab # [ 1.826722] systemd[1]: Detected architecture x86-64.474gitlab # [ 1.828954] systemd[1]: Running in initrd.475gitlab # [ 1.831571] systemd[1]: Initializing machine ID from random generator.476gitlab # [ 1.834522] systemd[1]: Hostname set to <gitlab>.477gitlab # [ 1.967200] systemd[1]: bpf-restrict-fs: LSM BPF program attached478gitlab # [ 2.022081] systemd[1]: Queued start job for default target Initrd Default Target.479gitlab # [ 2.033574] systemd[1]: Created slice Slice /system/modprobe.480gitlab # [ 2.034789] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.481gitlab # [ 2.036539] systemd[1]: Expecting device /dev/disk/by-label/nix-store...482gitlab # [ 2.038133] systemd[1]: Expecting device /dev/disk/by-label/nixos...483gitlab # [ 2.039264] systemd[1]: Reached target Path Units.484gitlab # [ 2.040165] systemd[1]: Reached target Slice Units.485gitlab # [ 2.041059] systemd[1]: Reached target Swaps.486gitlab # [ 2.041917] systemd[1]: Reached target Timer Units.487gitlab # [ 2.042948] systemd[1]: Listening on D-Bus System Message Bus Socket.488gitlab # [ 2.044211] systemd[1]: Listening on Journal Socket (/dev/log).489gitlab # [ 2.045390] systemd[1]: Listening on Journal Sockets.490gitlab # [ 2.046413] systemd[1]: Listening on udev Control Socket.491gitlab # [ 2.047477] systemd[1]: Listening on udev Kernel Socket.492gitlab # [ 2.048480] systemd[1]: Reached target Socket Units.493gitlab # [ 2.050500] systemd[1]: Starting Create List of Static Device Nodes...494gitlab # [ 2.052744] systemd[1]: Starting Load Kernel Module 9pnet_virtio...495gitlab # [ 2.054846] systemd[1]: Starting Load Kernel Module configfs...496gitlab # [ 2.057724] systemd[1]: Starting Journal Service...497gitlab # [ 2.061990] systemd[1]: Starting Load Kernel Modules...498gitlab # [ 2.064503] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os499gitlab # [ 2.070986] systemd[1]: Starting Coldplug All udev Devices...500gitlab # [ 2.076450] systemd[1]: Finished Create List of Static Device Nodes.501gitlab # [ 2.080778] systemd[1]: modprobe@configfs.service: Deactivated successfully.502gitlab # [ 2.082644] systemd-journald[91]: Collecting audit messages is disabled.503gitlab # [ 2.086795] systemd[1]: Finished Load Kernel Module configfs.504gitlab # [ 2.090668] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config505gitlab # [ 2.097595] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...506gitlab # [ 2.118972] netfs: FS-Cache loaded507gitlab # [ 2.122390] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.508gitlab # [ 2.125607] systemd[1]: Starting Create Static Device Nodes in /dev...509gitlab # [ 2.130971] 9pnet: Installing 9P2000 support510gitlab # [ 2.133918] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.511gitlab # [ 2.137088] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev512gitlab # [ 2.139377] systemd[1]: Started Journal Service.513gitlab # [ 2.004088] systemd-modules-load[92]: Using 4 probe threads514gitlab # [ 2.005439] systemd-modules-load[92]: Inserted module 'virtio_balloon'515gitlab # [ 2.006619] systemd-modules-load[92]: Inserted module 'virtio_gpu'516gitlab # [ 2.007650] systemd-modules-load[92]: Inserted module 'dm_mod'517gitlab # [ 2.008803] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.518gitlab # [ 2.010139] systemd[1]: Finished Load Kernel Module 9pnet_virtio.519gitlab # [ 2.011232] systemd[1]: Finished Load Kernel Modules.520gitlab # [ 2.012169] systemd[1]: Starting Apply Kernel Variables...521gitlab # [ 2.013209] systemd[1]: Finished Create Static Device Nodes in /dev.522gitlab # [ 2.014743] systemd[1]: Reached target Preparation for Local File Systems.523gitlab # [ 2.015792] systemd[1]: Reached target Local File Systems.524gitlab # [ 2.019170] systemd[1]: Starting Create System Files and Directories...525gitlab # [ 2.021160] systemd[1]: Starting Rule-based Manager for Device Events and Files...526gitlab # [ 2.027490] systemd[1]: Finished Apply Kernel Variables.527gitlab # [ 2.029133] systemd[1]: Finished Create System Files and Directories.528gitlab # [ 2.043045] systemd-udevd[111]: Using default interface naming scheme 'v261'.529gitlab # [ 2.053598] systemd[1]: Started Rule-based Manager for Device Events and Files.530gitlab # [ 2.089775] systemd[1]: Finished Coldplug All udev Devices.531gitlab # [ 2.090763] systemd[1]: Reached target System Initialization.532gitlab # [ 2.092139] systemd[1]: Reached target Basic System.533gitlab # [ 2.301807] virtio_blk virtio4: 4/0/0 default/read/poll queues534gitlab # [ 2.303514] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12535gitlab # [ 2.305856] serio: i8042 KBD port at 0x60,0x64 irq 1536gitlab # [ 2.306666] serio: i8042 AUX port at 0x60,0x64 irq 12537gitlab # [ 2.308864] uhci_hcd 0000:00:01.2: UHCI Host Controller538gitlab # [ 2.309784] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1539gitlab # [ 2.311566] uhci_hcd 0000:00:01.2: detected 2 ports540gitlab # [ 2.314021] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140541gitlab # [ 2.315227] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18542gitlab # [ 2.316503] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1543gitlab # [ 2.316651] SCSI subsystem initialized544gitlab # [ 2.317462] usb usb1: Product: UHCI Host Controller545gitlab # [ 2.317464] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd546gitlab # [ 2.317466] usb usb1: SerialNumber: 0000:00:01.2547gitlab # [ 2.317984] hub 1-0:1.0: USB hub found548gitlab # [ 2.321990] hub 1-0:1.0: 2 ports detected549gitlab # [ 2.366206] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)550gitlab # [ 2.386485] scsi host0: ata_piix551gitlab # [ 2.394463] virtio_blk virtio5: 4/0/0 default/read/poll queues552gitlab # [ 2.397580] scsi host1: ata_piix553gitlab # [ 2.399634] virtio_blk virtio5: [vdb] 11843312 512-byte logical blocks (6.06 GB/5.65 GiB)554gitlab # [ 2.266322] systemd[1]: Starting Virtual Console Setup...555gitlab # [ 2.267646] (udev-worker)[133]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.556gitlab # [ 2.270452] (udev-worker)[133]: Network interface NamePolicy= disabled on kernel command line.557gitlab # [ 2.408463] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0558gitlab # [ 2.409706] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0559gitlab # [ 2.274577] (udev-worker)[116]: Network interface NamePolicy= disabled on kernel command line.560gitlab # [ 2.413293] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0561gitlab # [ 2.283266] systemd-vconsole-setup[146]: Configuration of first virtual console was skipped, ignoring remaining ones.562gitlab # [ 2.285669] systemd[1]: Finished Virtual Console Setup.563gitlab # [ 2.557050] usb 1-1: new full-speed USB device number 2 using uhci_hcd564gitlab # [ 2.573625] ata2: found unknown device (class 0)565gitlab # [ 2.576594] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100566gitlab # [ 2.580856] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5567gitlab # [ 2.497218] systemd[1]: Found device /dev/disk/by-label/nixos.568gitlab # [ 2.639425] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray569gitlab # [ 2.503095] systemd[1]: Found device /dev/disk/by-label/nix-store.570gitlab # [ 2.507691] systemd[1]: Reached target Initrd Root Device.571gitlab # [ 2.510637] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...572gitlab # [ 2.680783] cdrom: Uniform CD-ROM driver Revision: 3.20573gitlab # [ 2.557277] systemd-fsck[158]: nixos: clean, 12/65536 files, 13019/262144 blocks574gitlab # [ 2.564394] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.575gitlab # [ 2.728049] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00576gitlab # [ 2.731263] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10577gitlab # [ 2.733952] usb 1-1: Product: QEMU USB Tablet578gitlab # [ 2.735559] usb 1-1: Manufacturer: QEMU579gitlab # [ 2.737182] usb 1-1: SerialNumber: 28754-0000:00:01.2-1580gitlab # [ 2.766971] hid: raw HID events driver (C) Jiri Kosina581gitlab # [ 2.778462] usbcore: registered new interface driver usbhid582gitlab # [ 2.780471] usbhid: USB HID core driver583gitlab # [ 2.788347] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2584gitlab # [ 2.791665] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0585gitlab # [ 2.942241] systemd[1]: Mounting /sysroot...586gitlab # [ 3.229686] EXT4-fs (vda): mounted filesystem 621a1832-77dc-4255-9991-f8f642a8885d r/w with ordered data mode. Quota mode: none.587gitlab # [ 3.100206] systemd[1]: Mounted /sysroot.588gitlab # [ 3.101640] systemd[1]: Reached target Initrd Root File System.589gitlab # [ 3.105326] systemd[1]: Mounting /sysroot/nix/.ro-store...590gitlab # [ 3.107535] systemd[1]: Mounting /sysroot/nix/.rw-store...591gitlab # [ 3.119555] systemd[1]: Mounting /sysroot/run...592gitlab # [ 3.123200] systemd[1]: Mounting /sysroot/tmp/shared...593gitlab # [ 3.127160] systemd[1]: Mounting /sysroot/tmp/xchg...594gitlab # [ 3.133193] systemd[1]: Starting Mountpoints Configured in the Real Root...595gitlab # [ 3.137143] systemd[1]: Mounted /sysroot/nix/.rw-store.596gitlab # [ 3.139216] systemd[1]: Starting rw-sysroot-nix-store.service...597gitlab # [ 3.144178] systemd-sysroot-fstab-check[179]: /sysroot should be mounted in the initrd, will request daemon-reload.598gitlab # [ 3.148080] systemd[1]: Reload requested from client PID 179 ('systemd-sysroot') (unit initrd-parse-etc.service)...599gitlab # [ 3.152340] systemd[1]: Reloading...600gitlab # [ 3.291414] 9p: Installing v9fs 9p2000 file system support601gitlab # [ 3.293207] erofs (device vdb): mounted with root inode @ nid 128.602gitlab # [ 3.210468] systemd[1]: Reloading finished in 64 ms.603gitlab # [ 3.233590] systemd-sysroot-fstab-check[179]: Requesting initrd-fs.target/start/replace...604gitlab # [ 3.236765] systemd[1]: Mounted /sysroot/nix/.ro-store.605gitlab # [ 3.238853] systemd[1]: Mounted /sysroot/run.606gitlab # [ 3.240651] systemd[1]: Mounted /sysroot/tmp/shared.607gitlab # [ 3.242566] systemd[1]: Mounted /sysroot/tmp/xchg.608gitlab # [ 3.244720] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.609gitlab # [ 3.247428] systemd[1]: Finished rw-sysroot-nix-store.service.610gitlab # [ 3.249602] systemd-sysroot-fstab-check[179]: Requesting swap.target/start/replace...611gitlab # [ 3.252332] systemd[1]: Starting rw-sysroot-nix-store.service...612gitlab # [ 3.254676] systemd[1]: initrd-parse-etc.service: Deactivated successfully.613gitlab # [ 3.257270] systemd[1]: Finished Mountpoints Configured in the Real Root.614gitlab # [ 3.260075] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.615gitlab # [ 3.265356] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.616gitlab # [ 3.268144] systemd[1]: Finished rw-sysroot-nix-store.service.617gitlab # [ 3.942511] systemd[1]: Mounting /sysroot/nix/store...618gitlab # [ 3.995697] systemd[1]: Mounted /sysroot/nix/store.619gitlab # [ 3.997741] systemd[1]: Reached target Initrd File Systems.620gitlab # [ 3.999895] systemd[1]: Starting Find NixOS closure...621gitlab # [ 4.001883] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...622gitlab # [ 4.029579] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.623gitlab # [ 4.032420] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.624gitlab # [ 4.051274] systemd[1]: Finished Find NixOS closure.625gitlab # [ 4.053118] systemd[1]: Reached target Initrd Default Target.626gitlab # [ 4.055160] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...627gitlab # [ 4.088067] systemd[1]: Stopped target Initrd Default Target.628gitlab # [ 4.090426] systemd[1]: Stopped target Basic System.629gitlab # [ 4.092336] systemd[1]: Stopped target Initrd Root Device.630gitlab # [ 4.094392] systemd[1]: Stopped target Path Units.631gitlab # [ 4.096339] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.632gitlab # [ 4.099098] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.633gitlab # [ 4.105412] systemd[1]: Stopped target Slice Units.634gitlab # [ 4.107448] systemd[1]: Stopped target Socket Units.635gitlab # [ 4.110392] systemd[1]: Stopped target System Initialization.636gitlab # [ 4.112585] systemd[1]: Stopped target Swaps.637gitlab # [ 4.114432] systemd[1]: Stopped target Timer Units.638gitlab # [ 4.116476] systemd[1]: dbus.socket: Deactivated successfully.639gitlab # [ 4.118856] systemd[1]: Closed D-Bus System Message Bus Socket.640gitlab # [ 4.121177] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.641gitlab # [ 4.123781] systemd[1]: Stopped Find NixOS closure.642gitlab # [ 4.125691] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio643gitlab # [ 4.128734] systemd[1]: Starting rw-sysroot-nix-store.service...644gitlab # [ 4.130472] systemd[1]: systemd-sysctl.service: Deactivated successfully.645gitlab # [ 4.132410] systemd[1]: Stopped Apply Kernel Variables.646gitlab # [ 4.133949] systemd[1]: systemd-modules-load.service: Deactivated successfully.647gitlab # [ 4.135972] systemd[1]: Stopped Load Kernel Modules.648gitlab # [ 4.137577] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.649gitlab # [ 4.139782] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.650gitlab # [ 4.141956] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.651gitlab # [ 4.144267] systemd[1]: Stopped Create System Files and Directories.652gitlab # [ 4.146192] systemd[1]: Stopped target Local File Systems.653gitlab # [ 4.147403] systemd[1]: Stopped target Preparation for Local File Systems.654gitlab # [ 4.148484] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.655gitlab # [ 4.149634] systemd[1]: Stopped Coldplug All udev Devices.656gitlab # [ 4.150539] systemd[1]: Stopping Rule-based Manager for Device Events and Files...657gitlab # [ 4.151754] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.658gitlab # [ 4.152907] systemd[1]: Stopped Virtual Console Setup.659gitlab # [ 4.153739] systemd[1]: initrd-cleanup.service: Deactivated successfully.660gitlab # [ 4.154836] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.661gitlab # [ 4.155865] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.662gitlab # [ 4.156915] systemd[1]: Finished rw-sysroot-nix-store.service.663gitlab # [ 4.157940] systemd[1]: systemd-udevd.service: Deactivated successfully.664gitlab # [ 4.158938] systemd[1]: Stopped Rule-based Manager for Device Events and Files.665gitlab # [ 4.160142] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.666gitlab # [ 4.161255] systemd[1]: Closed udev Control Socket.667gitlab # [ 4.162113] systemd[1]: Starting Cleanup udev Database...668gitlab # [ 4.163060] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.669gitlab # [ 4.164263] systemd[1]: Stopped Create Static Device Nodes in /dev.670gitlab # [ 4.165233] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.671gitlab # [ 4.166458] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.672gitlab # [ 4.167519] systemd[1]: kmod-static-nodes.service: Deactivated successfully.673gitlab # [ 4.168542] systemd[1]: Stopped Create List of Static Device Nodes.674gitlab # [ 4.169388] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.675gitlab # [ 4.170433] systemd[1]: Finished Cleanup udev Database.676gitlab # [ 4.171165] systemd[1]: Reached target Switch Root.677gitlab # [ 4.171989] systemd[1]: Starting NixOS Activation...678gitlab # [ 4.276129] initrd-nixos-activation-start[232]: booting system configuration /nix/store/glc83l11q2fmszjn3hzi23f1vqm5wy20-nixos-system-gitlab-test679gitlab # [ 4.313857] initrd-nixos-activation-start[232]: running activation script...680gitlab # [ 4.520303] initrd-nixos-activation-start[255]: setting up /etc...681gitlab # [ 4.598420] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.682gitlab # [ 4.601210] systemd[1]: Finished NixOS Activation.683gitlab # [ 4.603105] systemd[1]: Starting Switch Root...684gitlab # [ 4.637990] systemd[1]: Switching root.685gitlab # [ 4.825742] systemd-journald[91]: Received SIGTERM from PID 1 (systemd).686gitlab # [ 4.926044] NET: Registered PF_VSOCK protocol family687gitlab # [ 5.288634] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)688gitlab # [ 5.295218] systemd[1]: Detected virtualization kvm.689gitlab # [ 5.297076] systemd[1]: Detected architecture x86-64.690gitlab # [ 5.299045] systemd[1]: Detected first boot.691gitlab # [ 5.301614] systemd[1]: Initializing machine ID from random generator.692gitlab # [ 5.443451] systemd[1]: bpf-restrict-fs: LSM BPF program attached693gitlab # [ 5.523029] systemd[1]: Applying preset policy.694gitlab # [ 5.658934] systemd[1]: Populated /etc with preset unit settings.695gitlab # [ 5.771635] systemd[1]: initrd-switch-root.service: Deactivated successfully.696gitlab # [ 5.773024] systemd[1]: Stopped initrd-switch-root.service.697gitlab # [ 5.775005] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.698gitlab # [ 5.777122] systemd[1]: Created slice Slice /system/getty.699gitlab # [ 5.778536] systemd[1]: Created slice GitLab DevOps Platform Slice.700gitlab # [ 5.780265] systemd[1]: Created slice User and Session Slice.701gitlab # [ 5.781232] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.702gitlab # [ 5.782563] systemd[1]: Started Forward Password Requests to Wall Directory Watch.703gitlab # [ 5.783702] systemd[1]: Expecting device /dev/hvc0...704gitlab # [ 5.784562] systemd[1]: Expecting device /dev/ttyS0...705gitlab # [ 5.785336] systemd[1]: Reached target Local Encrypted Volumes.706gitlab # [ 5.786174] systemd[1]: Stopped target initrd-fs.target.707gitlab # [ 5.786977] systemd[1]: Stopped target initrd-root-fs.target.708gitlab # [ 5.787815] systemd[1]: Stopped target initrd-switch-root.target.709gitlab # [ 5.788830] systemd[1]: Reached target Virtual Machines and Containers.710gitlab # [ 5.789794] systemd[1]: Reached target Path Units.711gitlab # [ 5.790543] systemd[1]: Reached target Remote File Systems.712gitlab # [ 5.791344] systemd[1]: Reached target Slice Units.713gitlab # [ 5.792084] systemd[1]: Reached target Swaps.714gitlab # [ 5.793525] systemd[1]: Listening on Query the User Interactively for a Password.715gitlab # [ 5.795471] systemd[1]: Listening on Process Core Dump Socket.716gitlab # [ 5.796914] systemd[1]: Listening on Credential Encryption/Decryption.717gitlab # [ 5.798461] systemd[1]: Listening on Factory Reset Management.718gitlab # [ 5.799436] systemd[1]: Listening on Hostname Service Socket.719gitlab # [ 5.801675] systemd[1]: Starting Journal Log Access Socket...720gitlab # [ 5.803131] systemd[1]: Listening on Journal Audit Socket.721gitlab # [ 5.804784] systemd[1]: Listening on Console Output Muting Service Socket.722gitlab # [ 5.805994] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.723gitlab # [ 5.807128] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os724gitlab # [ 5.808543] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki725gitlab # [ 5.811199] systemd[1]: Listening on Disk Repartitioning Service Socket.726gitlab # [ 5.812257] systemd[1]: Listening on udev Control Socket.727gitlab # [ 5.813193] systemd[1]: Listening on udev Varlink Socket.728gitlab # [ 5.816078] systemd[1]: Mounting Huge Pages File System...729gitlab # [ 5.818233] systemd[1]: Mounting POSIX Message Queue File System...730gitlab # [ 5.820483] systemd[1]: Mounting Kernel Debug File System...731gitlab # [ 5.833266] systemd[1]: Mounting Kernel Trace File System...732gitlab # [ 5.837940] systemd[1]: Starting Create List of Static Device Nodes...733gitlab # [ 5.842340] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio734gitlab # [ 5.849621] systemd[1]: Starting Load Kernel Module configfs...735gitlab # [ 5.855122] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm736gitlab # [ 5.860057] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore737gitlab # [ 5.861720] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse738gitlab # [ 5.868161] systemd[1]: Mounting FUSE Control File System...739gitlab # [ 5.869078] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67740gitlab # [ 5.873261] systemd[1]: Starting Journal Service...741gitlab # [ 5.887454] systemd[1]: Starting Load Kernel Modules...742gitlab # [ 5.893758] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...743gitlab # [ 5.901965] systemd[1]: Starting Remount Root and Kernel File Systems...744gitlab # [ 5.904530] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os745gitlab # [ 5.910527] loop: module loaded746gitlab # [ 5.911558] systemd[1]: Starting Coldplug All udev Devices...747gitlab # [ 5.913021] systemd-journald[325]: Collecting audit messages is enabled.748gitlab # [ 5.920153] EXT4-fs (vda): re-mounted 621a1832-77dc-4255-9991-f8f642a8885d.749gitlab # [ 5.923161] systemd[1]: Listening on Journal Log Access Socket.750gitlab # [ 5.924358] systemd[1]: Mounted Huge Pages File System.751gitlab # [ 5.925392] systemd[1]: Mounted POSIX Message Queue File System.752gitlab # [ 5.926390] systemd[1]: Mounted Kernel Debug File System.753gitlab # [ 5.927335] systemd[1]: Mounted Kernel Trace File System.754gitlab # [ 5.928647] systemd[1]: Finished Create List of Static Device Nodes.755gitlab # [ 5.929945] systemd[1]: modprobe@configfs.service: Deactivated successfully.756gitlab # [ 5.931404] systemd[1]: Finished Load Kernel Module configfs.757gitlab # [ 5.932489] systemd[1]: Mounted FUSE Control File System.758gitlab # [ 5.796739] systemd[1]: Queued start job for default target M[ 5.933786] systemd[1]: Finished Load Kernel Modules.759gitlab # ulti-User System.760gitlab # [ 5.935141] systemd[1]: Started Journal Service.761gitlab # [ 5.798626] systemd[1]: Unnecessary job was removed for /dev/vdb.762gitlab # [ 5.800150] systemd[1]: systemd-journald.service: Deactivated successfully.763gitlab # [ 5.801345] systemd-modules-load[327]: Using 3 probe threads764gitlab # [ 5.802400] systemd-modules-load[327]: Inserted module 'loop'765gitlab # [ 5.803507] systemd-modules-load[327]: Inserted module 'tls'766gitlab # [ 5.804448] systemd[1]: Finished Remount Root and Kernel File Systems.767gitlab # [ 5.807181] systemd[1]: Listening on Disk Image Download Service Socket.768gitlab # [ 5.808297] systemd[1]: Mounting Kernel Configuration File System...769gitlab # [ 5.809364] systemd[1]: Starting Firewall...770gitlab # [ 5.810244] systemd[1]: Starting Flush Journal to Persistent Storage...771gitlab # [ 5.811778] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore772gitlab # [ 5.814183] systemd-oomd[328]: No swap; memory pressure usage will be degraded773gitlab # [ 5.815710] systemd[1]: Starting Load/Save OS Random Seed...774gitlab # [ 5.955013] systemd-journald[325]: Received client request to flush runtime journal.775gitlab # [ 5.861622] systemd[1]: Starting Apply Kernel Variables...776gitlab # [ 5.863858] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...777gitlab # [ 5.865384] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os778gitlab # [ 5.866888] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.779gitlab # [ 5.868089] systemd[1]: Mounted Kernel Configuration File System.780gitlab # [ 5.869071] systemd[1]: Finished Apply Kernel Variables.781gitlab # [ 5.869918] systemd[1]: Finished Load/Save OS Random Seed.782gitlab # [ 5.870799] systemd[1]: Reached target First Boot Complete.783gitlab # [ 5.871664] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.784gitlab # [ 5.872759] systemd[1]: Starting Create Static Device Nodes in /dev...785gitlab # [ 5.873731] systemd[1]: Finished Flush Journal to Persistent Storage.786gitlab # [ 5.874729] systemd[1]: Finished Create Static Device Nodes in /dev.787gitlab # [ 5.875635] systemd[1]: Reached target Preparation for Local File Systems.788gitlab # [ 5.876658] systemd[1]: Starting Rule-based Manager for Device Events and Files...789gitlab # [ 5.901886] systemd-udevd[363]: Using default interface naming scheme 'v261'.790gitlab # [ 5.930377] systemd[1]: Started Rule-based Manager for Device Events and Files.791gitlab # [ 5.940155] systemd[1]: Finished Coldplug All udev Devices.792gitlab # [ 6.001917] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse793gitlab # [ 6.017892] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.794gitlab # [ 6.035566] (udev-worker)[432]: Network interface NamePolicy= disabled on kernel command line.795gitlab # [ 6.047725] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.796gitlab # [ 6.062793] (udev-worker)[422]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.797gitlab # [ 6.065250] (udev-worker)[422]: Network interface NamePolicy= disabled on kernel command line.798gitlab # [ 6.076952] systemd[1]: Condition check resulted in Virtio network device being skipped.799gitlab # [ 6.079105] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore800gitlab # [ 6.080718] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67801gitlab # [ 6.084140] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore802gitlab # [ 6.085950] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os803gitlab # [ 6.087335] systemd[1]: TPM SRK Setup skipped, unmet condition check Conditio[ 6.224360] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3804gitlab # nSecurity=measured-os805gitlab # [ 6.234533] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console806gitlab # [ 6.237340] ACPI: button: Power Button [PWRF]807gitlab # [ 6.237711] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0808gitlab # [ 6.237773] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD809gitlab # [ 6.252842] Console: switching to colour dummy device 80x25810gitlab # [ 6.255990] [drm] Found bochs VGA, ID 0xb0c5.811gitlab # [ 6.256472] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.812gitlab # [ 6.258930] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic813gitlab # [ 6.259654] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0814gitlab # [ 6.268914] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5815gitlab # [ 6.275716] Console: switching to colour frame buffer device 160x50816gitlab # [ 6.278306] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device817gitlab # [ 6.283623] rtc_cmos 00:05: RTC can wake from S4818gitlab # [ 6.286051] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4819gitlab # [ 6.293381] parport_pc 00:03: reported by Plug and Play ACPI820gitlab # [ 6.295326] Floppy drive(s): fd0 is 2.88M AMI BIOS821gitlab # [ 6.295924] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]822gitlab # [ 6.164130] systemd[1]: Finished Firewall.823gitlab # [ 6.307588] rtc_cmos 00:05: registered as rtc0824gitlab # [ 6.308399] rtc_cmos 00:05: setting system clock to 2026-09-08T05:54:23 UTC (1788846863)825gitlab # [ 6.309648] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs826gitlab # [ 6.310375] FDC 0 is a S82078B827gitlab # [ 6.316595] systemd-journald[325]: Time jumped backwards, rotating.828gitlab # [ 6.319610] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input6829gitlab # [ 6.384228] mousedev: PS/2 mouse device common for all mice830gitlab # [ 6.387555] ppdev: user-space parallel port driver831gitlab # [ 6.251358] systemd[1]: Starting Virtual Console Setup...832gitlab # [ 6.265050] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.833gitlab # [ 6.266198] systemd[1]: Stopped Virtual Console Setup.834gitlab # [ 6.272078] systemd[1]: Starting Virtual Console Setup...835gitlab # [ 6.288640] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.836gitlab # [ 6.289724] systemd[1]: Stopped Virtual Console Setup.837gitlab # [ 6.294225] systemd[1]: Starting Virtual Console Setup...838gitlab # [ 6.353490] systemd-vconsole-setup[501]: Configuration of first virtual console was skipped, ignoring remaining ones.839gitlab # [ 6.355355] systemd[1]: Finished Virtual Console Setup.840gitlab # [ 6.520937] kvm_amd: TSC scaling supported841gitlab # [ 6.521428] kvm_amd: Nested Virtualization enabled842gitlab # [ 6.521989] kvm_amd: Nested Paging enabled843gitlab # [ 6.522441] kvm_amd: LBR virtualization supported844gitlab # [ 6.522976] kvm_amd: Virtual VMLOAD VMSAVE supported845gitlab # [ 6.523521] kvm_amd: Virtual GIF supported846gitlab # [ 6.523995] kvm_amd: Virtual NMI enabled847gitlab # [ 6.556958] EDAC MC: Ver: 3.0.0848gitlab # [ 6.640199] systemd[1]: Mounting /run/wrappers...849gitlab # [ 6.666219] systemd[1]: Mounted /run/wrappers.850gitlab # [ 6.668160] systemd[1]: Reached target Local File Systems.851gitlab # [ 6.670315] systemd[1]: Listening on Boot Loader Control Service Socket.852gitlab # [ 6.672768] systemd[1]: Starting register-nix-paths.service...853gitlab # [ 6.674871] systemd[1]: Starting Create SUID/SGID Wrappers...854gitlab # [ 6.677151] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.855gitlab # [ 6.680250] systemd[1]: Starting Save Transient machine-id to Disk...856gitlab # [ 6.689223] systemd[1]: Starting Create System Files and Directories...857gitlab # [ 6.722143] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.858gitlab # [ 6.726917] systemd[1]: Finished Save Transient machine-id to Disk.859gitlab # [ 6.736907] systemd[1]: Finished Create System Files and Directories.860gitlab # [ 6.741562] systemd[1]: Starting Rebuild Journal Catalog...861gitlab # [ 6.743771] systemd[1]: Starting Record System Boot/Shutdown in UTMP...862gitlab # [ 6.759272] systemd[1]: Finished Record System Boot/Shutdown in UTMP.863gitlab # [ 6.778513] systemd[1]: Finished Rebuild Journal Catalog.864gitlab # [ 6.780471] systemd[1]: Starting Update is Completed...865gitlab # [ 6.795240] systemd[1]: Finished Update is Completed.866gitlab # [ 6.835487] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.867gitlab # [ 6.837913] systemd[1]: Finished Create SUID/SGID Wrappers.868gitlab # [ 7.051787] systemd[1]: Finished register-nix-paths.service.869gitlab # [ 7.054218] systemd[1]: Reached target System Initialization.870gitlab # [ 7.056420] systemd[1]: Started Discard unused filesystem blocks once a week.871gitlab # [ 7.058992] systemd[1]: Started logrotate.timer.872gitlab # [ 7.060898] systemd[1]: Started Daily Cleanup of Temporary Directories.873gitlab # [ 7.063365] systemd[1]: Reached target Timer Units.874gitlab # [ 7.065319] systemd[1]: Listening on D-Bus System Message Bus Socket.875gitlab # [ 7.067679] systemd[1]: Listening on Nix Daemon Socket.876gitlab # [ 7.069651] systemd[1]: Starting nixbot CI service socket...877gitlab # [ 7.071767] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.878gitlab # [ 7.074731] systemd[1]: Listening on nixbot CI service socket.879gitlab # [ 7.076920] systemd[1]: Reached target Socket Units.880gitlab # [ 7.078984] systemd[1]: Starting D-Bus System Message Bus...881gitlab # [ 7.136460] dbus-broker-launch[584]: Looking up NSS user entry for 'systemd-timesync'...882gitlab # [ 7.139759] dbus-broker-launch[584]: NSS returned no entry for 'systemd-timesync'883gitlab # [ 7.142466] dbus-broker-launch[584]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"884gitlab # [ 7.147685] systemd[1]: Started D-Bus System Message Bus.885gitlab # [ 7.167642] dbus-broker-launch[584]: Ready886gitlab # [ 7.171852] systemd[1]: Reached target Basic System.887gitlab # [ 7.174847] systemd[1]: Started backdoor.service.888gitlab # [ 7.179973] systemd[1]: Starting gitlab-config.service...889gitlab # [ 7.182372] systemd[1]: Starting Import lastlog data into lastlog2 database...890gitlab # [ 7.193420] systemd[1]: Starting Logrotate configuration check...891gitlab # [ 7.200178] systemd[1]: Starting Name Service Cache Daemon (nsncd)...892gitlab # [ 7.209927] systemd[1]: Starting Post-Boot Actions...893gitlab # [ 7.215522] systemd[1]: Started Reset console on configuration changes.894gitlab # [ 7.219801] systemd[1]: Starting resolvconf update...895gitlab # connecting to host...896gitlab # [ 7.226290] logrotate[589]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.897gitlab # [ 7.229111] logrotate[589]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf898gitlab # [ 7.229977] logrotate[589]: note: 'monthly' overrides previously specified 'weekly'899gitlab: Guest shell says: b'Spawning backdoor root shell...\n'900gitlab # [ 7.233156] logrotate[589]: Reading state from file: /var/lib/logrotate.status901gitlab # [ 7.234060] logrotate[589]: state file /var/lib/logrotate.status does not exist902gitlab # [ 7.234957] logrotate[589]: Allocating hash table for state file, size 64 entries903gitlab: connected to guest root shell904gitlab # [ 7.238391] logrotate[589]: Handling 4 logs905gitlab: (connecting took 7.87 seconds)906gitlab # [ 7.239288] logrotate[589]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed907gitlab: (finished: waiting for the VM to finish booting, in 7.87 seconds)908gitlab # [ 7.239860] logrotate[589]: considering log /var/log/btmp909gitlab # [ 7.241704] logrotate[589]: Creating new state910gitlab # [ 7.243130] logrotate[589]: Now: 2026-09-08 05:54911gitlab # [ 7.246561] logrotate[589]: Last rotated at 2026-09-08 05:00912gitlab # [ 7.247042] logrotate[589]: log does not need rotating (log has already been rotated)913gitlab # [ 7.247622] logrotate[589]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed914gitlab # [ 7.248119] logrotate[589]: considering log /var/log/wtmp915gitlab # [ 7.248529] logrotate[589]: Creating new state916gitlab # [ 7.248961] logrotate[589]: Now: 2026-09-08 05:54917gitlab # [ 7.249589] logrotate[589]: Last rotated at 2026-09-08 05:00918gitlab # [ 7.250081] logrotate[589]: log does not need rotating (log has already been rotated)919gitlab # [ 7.250537] logrotate[589]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed920gitlab # [ 7.250973] logrotate[589]: switching euid from 0 to 165 and egid from 0 to 165 (pid 589)921gitlab # [ 7.251578] logrotate[589]: considering log /var/gitlab/state/log/*.log922gitlab # [ 7.252044] logrotate[589]: log /var/gitlab/state/log/*.log does not exist -- skipping923gitlab # [ 7.252493] logrotate[589]: Creating new state924gitlab # [ 7.252921] logrotate[589]: switching euid from 165 to 0 and egid from 165 to 0 (pid 589)925gitlab # [ 7.253536] logrotate[589]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed926gitlab # [ 7.253979] logrotate[589]: switching euid from 0 to 60 and egid from 0 to 60 (pid 589)927gitlab # [ 7.254580] logrotate[589]: considering log /var/log/nginx/*.log928gitlab # [ 7.255032] logrotate[589]: log /var/log/nginx/*.log does not exist -- skipping929gitlab # [ 7.255463] logrotate[589]: Creating new state930gitlab # [ 7.255908] logrotate[589]: not running postrotate script, since no logs were rotated931gitlab # [ 7.257115] logrotate[589]: switching euid from 60 to 0 and egid from 60 to 0 (pid 589)932gitlab # [ 7.257851] nsncd[590]: Sep 08 05:54:24.569 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"933gitlab # [ 7.259363] systemd[1]: Started Name Service Cache Daemon (nsncd).934gitlab # [ 7.259913] systemd[1]: Finished Logrotate configuration check.935gitlab # [ 7.260756] systemd[1]: Finished Post-Boot Actions.936gitlab # [ 7.270464] systemd[1]: Finished Import lastlog data into lastlog2 database.937gitlab # [ 7.276396] systemd[1]: Reached target Host and Network Name Lookups.938gitlab # [ 7.277431] systemd[1]: Reached target User and Group Name Lookups.939gitlab # [ 7.279866] systemd[1]: Starting User Login Management...940gitlab # [ 7.293949] systemd[1]: Stopped target Host and Network Name Lookups.941gitlab # [ 7.294456] systemd[1]: Stopping Host and Network Name Lookups...942gitlab # [ 7.294900] systemd[1]: Stopped target User and Group Name Lookups.943gitlab # [ 7.295514] systemd[1]: Stopping User and Group Name Lookups...944gitlab # [ 7.297060] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...945gitlab # [ 7.299725] systemd[1]: nscd.service: Deactivated successfully.946gitlab # [ 7.302322] systemd[1]: Stopped Name Service Cache Daemon (nsncd).947gitlab # [ 7.302662] systemd[1]: nscd.service: Consumed 24ms CPU time over 101ms wall clock time, 7.3M memory peak, 5.5M read from disk.948gitlab # [ 7.305681] systemd[1]: Starting Name Service Cache Daemon (nsncd)...949gitlab # [ 7.320478] systemd-logind[647]: New seat seat0.950gitlab # [ 7.321834] systemd[1]: Started Name Service Cache Daemon (nsncd).951gitlab # [ 7.322788] nsncd[679]: Sep 08 05:54:24.649 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"952gitlab # [ 7.323683] systemd[1]: Reached target Host and Network Name Lookups.953gitlab # [ 7.324225] systemd[1]: Reached target User and Group Name Lookups.954gitlab # [ 7.326101] systemd-logind[647]: Watching system buttons on /dev/input/event2 (Power Button)955gitlab # [ 7.326258] systemd-logind[647]: Watching system buttons on /dev/input/event5 (QEMU Virtio Keyboard)956gitlab # [ 7.327364] systemd-logind[647]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)957gitlab # [ 7.327860] systemd[1]: Started User Login Management.958gitlab # [ 7.330492] systemd[1]: Starting linger-users.service...959gitlab # [ 7.338472] systemd[1]: Finished resolvconf update.960gitlab # [ 7.339819] systemd[1]: Reached target Preparation for Network.961gitlab # [ 7.342274] systemd[1]: Starting DHCP Client...962gitlab # [ 7.343701] systemd[1]: Starting Address configuration of eth1...963gitlab # [ 7.346266] systemd[1]: Starting Extra networking commands....964gitlab # [ 7.347459] systemd[1]: linger-users.service: Deactivated successfully.965gitlab # [ 7.348377] systemd[1]: Finished linger-users.service.966gitlab # [ 7.369792] network-addresses-eth1-start[708]: adding address 192.168.1.1/24... done967gitlab # [ 7.372781] network-addresses-eth1-start[708]: adding address 2001:db8:1::1/64... done968gitlab # [ 7.378636] systemd[1]: Finished Address configuration of eth1.969gitlab # [ 7.411391] systemd[1]: Finished Extra networking commands..970gitlab # [ 7.413299] systemd[1]: Reached target Network.971gitlab # [ 7.416458] dhcpcd[722]: dhcpcd-10.3.2 starting972gitlab # [ 7.416785] systemd[1]: Starting gitlab-workhorse.service...973gitlab # [ 7.418925] dhcpcd[775]: dev: loaded udev974gitlab # [ 7.420765] systemd[1]: Starting Nginx Web Server...975gitlab # [ 7.561161] 8021q: 802.1Q VLAN Support v1.8976gitlab # [ 7.561703] 8021q: adding VLAN 0 to HW filter on device eth1977gitlab # [ 7.425113] systemd[1]: Starting PostgreSQL Server...978gitlab # [ 7.427351] systemd[1]: Starting Redis Server - redis-gitlab...979gitlab # [ 7.433864] systemd[1]: Starting Permit User Sessions...980gitlab # [ 7.443029] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.981gitlab # [ 7.449477] systemd[1]: Finished Permit User Sessions.982gitlab # [ 7.455529] systemd[1]: Started Getty on tty1.983gitlab # [ 7.455818] systemd[1]: Reached target Login Prompts.984gitlab # [ 7.650686] cfg80211: Loading compiled-in X.509 certificates for regulatory database985gitlab # [ 7.659175] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'986gitlab # [ 7.660689] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'987gitlab # [ 7.662770] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2988gitlab # [ 7.664059] cfg80211: failed to load regulatory.db989gitlab # [ 7.555645] nginx-pre-start[799]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok990gitlab # [ 7.557601] nginx-pre-start[799]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful991gitlab # [ 7.700619] 8021q: adding VLAN 0 to HW filter on device eth0992gitlab # [ 7.565777] systemd[1]: Started Nginx Web Server.993gitlab # [ 7.566831] redis-server[798]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.994gitlab # [ 7.569245] redis-server[798]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo995gitlab # [ 7.570588] redis-server[798]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=798, just started996gitlab # [ 7.572300] redis-server[798]: Configuration loaded997gitlab # [ 7.573203] systemd[1]: Started Redis Server - redis-gitlab.998gitlab # [ 7.574095] redis[798]: monotonic clock: POSIX clock_gettime999gitlab # [ 7.575353] redis[798]: Running mode=standalone, port=0.1000gitlab # [ 7.576409] redis[798]: Server initialized1001gitlab # [ 7.577455] redis[798]: Ready to accept connections unix1002gitlab # [ 7.578914] redis[798]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1003gitlab # [ 7.581470] postgresql-pre-start[803]: The files belonging to this database system will be owned by user "postgres".1004gitlab # [ 7.583130] postgresql-pre-start[803]: This user must also own the server process.1005gitlab # [ 7.584231] dhcpcd[775]: eth0: waiting for carrier1006gitlab # [ 7.585099] postgresql-pre-start[803]: The database cluster will be initialized with locale "en_US.UTF-8".1007gitlab # [ 7.586538] postgresql-pre-start[803]: The default database encoding has accordingly been set to "UTF8".1008gitlab # [ 7.587961] postgresql-pre-start[803]: The default text search configuration will be set to "english".1009gitlab # [ 7.589474] postgresql-pre-start[803]: Data page checksums are enabled.1010gitlab # [ 7.590582] postgresql-pre-start[803]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok1011gitlab # [ 7.592200] postgresql-pre-start[803]: creating subdirectories ... ok1012gitlab # [ 7.593299] postgresql-pre-start[803]: selecting dynamic shared memory implementation ... posix1013gitlab # [ 7.594780] dhcpcd[775]: eth0: carrier acquired1014gitlab # [ 7.595569] dhcpcd[775]: DUID 00:01:00:01:32:32:5f:90:52:54:00:12:34:561015gitlab # [ 7.596596] dhcpcd[775]: eth0: IAID 00:12:34:561016gitlab # [ 7.597474] dhcpcd[775]: eth0: adding address fe80::5054:ff:fe12:34561017gitlab # [ 7.614722] postgresql-pre-start[803]: selecting default "max_connections" ... 1001018gitlab # [ 7.660067] postgresql-pre-start[803]: selecting default "shared_buffers" ... 128MB1019gitlab # [ 7.920250] systemd[1]: Started gitlab-workhorse.service.1020gitlab # [ 8.054851] postgresql-pre-start[803]: selecting default time zone ... UTC1021gitlab # [ 8.057354] postgresql-pre-start[803]: creating configuration files ... ok1022gitlab # [ 8.137768] gitlab-workhorse[834]: time="2026-09-08T05:54:25Z" level=info msg=Starting build_time=19700101.000000 version=19.0.41023gitlab # [ 8.137983] gitlab-workhorse[834]: time="2026-09-08T05:54:25Z" level=info msg="Using redis/go-redis"1024gitlab # [ 8.138608] gitlab-workhorse[834]: time="2026-09-08T05:54:25Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1025gitlab # [ 8.211265] postgresql-pre-start[803]: running bootstrap script ... ok1026gitlab # [ 8.640234] postgresql-pre-start[803]: performing post-bootstrap initialization ... ok1027gitlab # [ 8.933492] postgresql-pre-start[803]: syncing data to disk ... ok1028gitlab # [ 8.933856] postgresql-pre-start[803]: initdb: warning: enabling "trust" authentication for local connections1029gitlab # [ 8.935492] postgresql-pre-start[803]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1030gitlab # [ 8.937175] postgresql-pre-start[803]: Success. You can now start the database server using:1031gitlab # [ 8.938380] postgresql-pre-start[803]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1032gitlab # [ 9.025516] postgres[858]: [858] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1033gitlab # [ 9.029626] postgres[858]: [858] LOG: listening on IPv6 address "::1", port 54321034gitlab # [ 9.030355] postgres[858]: [858] LOG: listening on IPv4 address "127.0.0.1", port 54321035gitlab # [ 9.038485] postgres[858]: [858] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1036gitlab # [ 9.052797] postgres[868]: [868] LOG: database system was shut down at 2026-09-08 05:54:25 GMT1037gitlab # [ 9.062525] postgres[858]: [858] LOG: database system is ready to accept connections1038gitlab # [ 9.070364] systemd[1]: Started PostgreSQL Server.1039gitlab # [ 9.075369] systemd[1]: Starting PostgreSQL Setup Scripts...1040gitlab # [ 9.244092] postgresql-setup-start[879]: CREATE DATABASE1041gitlab # [ 9.264044] postgresql-setup-start[889]: CREATE ROLE1042gitlab # [ 9.278406] postgresql-setup-start[891]: ALTER DATABASE1043gitlab # [ 9.302987] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[884]: mkdir -p /var/gitlab/state/home/.ssh: OK1044gitlab # [ 9.305329] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[884]: chmod 700 /var/gitlab/state/home/.ssh: OK1045gitlab # [ 9.306154] postgresql-setup-start[896]: CREATE ROLE1046gitlab # [ 9.308746] systemd[1]: Finished PostgreSQL Setup Scripts.1047gitlab # [ 9.309691] systemd[1]: Reached target PostgreSQL.1048gitlab # [ 9.310797] systemd[1]: Starting gitlab-postgresql.service...1049gitlab # [ 9.341889] dhcpcd[775]: eth0: soliciting a DHCP lease1050gitlab # [ 9.342260] systemd[1]: Finished gitlab-config.service.1051gitlab # [ 9.345319] systemd[1]: Started gitaly.service.1052gitlab # [ 9.348508] systemd[1]: Starting gitlab-db-config.service...1053gitlab # [ 9.488969] NET: Registered PF_PACKET protocol family1054gitlab # [ 9.358799] dhcpcd[775]: eth0: offered 10.0.2.15 from 10.0.2.21055gitlab # [ 9.362256] dhcpcd[775]: eth0: probing address 10.0.2.15/241056gitlab # [ 9.405380] gitlab-postgresql-start[915]: CREATE DATABASE1057gitlab # [ 9.434548] gitlab-postgresql-start[936]: CREATE EXTENSION1058gitlab # [ 9.511691] gitlab-postgresql-start[938]: CREATE EXTENSION1059gitlab # [ 9.515816] systemd[1]: Finished gitlab-postgresql.service.1060gitlab # [ 9.752186] dhcpcd[775]: eth0: soliciting an IPv6 router1061gitlab # [ 9.752780] dhcpcd[775]: eth0: Router Advertisement from fe80::21062gitlab # [ 9.753633] dhcpcd[775]: eth0: adding address fec0::5054:ff:fe12:3456/641063gitlab # [ 9.754561] dhcpcd[775]: eth0: adding route to fec0::/641064gitlab # [ 9.755304] dhcpcd[775]: eth0: adding default route via fe80::21065gitlab # [ 9.825538] gitaly[919]: time="2026-09-08T05:54:27.153Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=9191066gitlab # [ 9.826327] gitaly[919]: time="2026-09-08T05:54:27.153Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=9191067gitlab # [ 9.829272] gitaly[919]: time="2026-09-08T05:54:27.153Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=9191068gitlab # [ 9.830420] gitaly[919]: time="2026-09-08T05:54:27.153Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=9191069gitlab # [ 9.831367] gitaly[919]: time="2026-09-08T05:54:27.153Z" level=info msg="Starting Gitaly" pid=919 version=1070gitlab # [ 9.989909] gitaly[919]: time="2026-09-08T05:54:27.318Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=163 pid=9191071gitlab # [ 9.990446] gitaly[919]: time="2026-09-08T05:54:27.318Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=9191072gitlab # [ 9.991108] gitaly[919]: time="2026-09-08T05:54:27.318Z" level=info msg="finished initializing command factory" duration_ms=0 pid=9191073gitlab # [ 9.991649] gitaly[919]: time="2026-09-08T05:54:27.318Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-919/git-exec-3702918774.d/git pid=9191074gitlab # [ 9.995514] gitaly[919]: time="2026-09-08T05:54:27.323Z" level=info msg="finished detecting git version" duration_ms=5 pid=9191075gitlab # [ 9.996239] gitaly[919]: time="2026-09-08T05:54:27.323Z" level=info msg="using Git version" pid=919 version=2.53.g1076gitlab # [ 9.996946] gitaly[919]: time="2026-09-08T05:54:27.324Z" level=info msg="clearing disk cache object folder" pid=919 storage=default1077gitlab # [ 9.997673] gitaly[919]: time="2026-09-08T05:54:27.324Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2776431687 pid=919 storage=default1078gitlab # [ 9.998525] gitaly[919]: time="2026-09-08T05:54:27.324Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2776431687 pid=919 storage=default1079gitlab # [ 9.999118] gitaly[919]: time="2026-09-08T05:54:27.324Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=9191080gitlab # [ 9.999625] gitaly[919]: time="2026-09-08T05:54:27.324Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=9191081gitlab # [ 10.000156] gitaly[919]: time="2026-09-08T05:54:27.324Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2776431687 clear_duration_ms=0 pid=919 storage=default1082gitlab # [ 10.031408] gitaly[919]: time="2026-09-08T05:54:27.359Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=9191083gitlab # [ 10.031926] gitaly[919]: time="2026-09-08T05:54:27.359Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=919 schema=unix1084gitlab # [ 10.033601] gitaly[919]: time="2026-09-08T05:54:27.359Z" level=info msg="listening at address" address=/run/gitaly/gitaly-919/sock.d/intern pid=919 schema=unix1085gitlab # [ 10.034664] gitaly[919]: time="2026-09-08T05:54:27.359Z" level=info msg="counting repositories" pid=9191086gitlab # [ 10.035666] gitaly[919]: time="2026-09-08T05:54:27.361Z" level=info msg="starting to count repositories" pid=919 storage_path=/var/gitlab/state/repositories1087gitlab # [ 10.036809] gitaly[919]: time="2026-09-08T05:54:27.361Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=919 storage_path=/var/gitlab/state/repositories1088gitlab # [ 10.037291] gitaly[919]: time="2026-09-08T05:54:27.361Z" level=info msg="completed counting all repositories" counting_duration=0 pid=9191089gitlab # [ 10.044263] gitaly[919]: time="2026-09-08T05:54:27.372Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9191090gitlab # [ 10.044545] gitaly[919]: time="2026-09-08T05:54:27.372Z" level=info msg="Started Gitaly" duration_ms=218 pid=9191091gitlab # [ 10.045074] gitaly[919]: time="2026-09-08T05:54:27.372Z" level=info msg="finished tempdir cleaner walk" pid=919 storage=default time_ms=01092gitlab # [ 10.045543] gitaly[919]: time="2026-09-08T05:54:27.372Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9191093gitlab # [ 10.046101] gitaly[919]: time="2026-09-08T05:54:27.372Z" level=info msg="maintenance: daily scheduled" pid=919 scheduled="2026-09-08 12:00:00 +0000 UTC"1094gitlab # [ 10.690623] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[926]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1095gitlab # [ 10.691704] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[926]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1096gitlab # [ 10.724320] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[926]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1097gitlab # [ 12.043123] gitaly[919]: time="2026-09-08T05:54:29.370Z" level=info msg="License database preloaded" duration_ms=2216 pid=9191098gitlab # [ 14.634804] dhcpcd[775]: eth0: leased 10.0.2.15 for 86400 seconds1099gitlab # [ 14.635245] dhcpcd[775]: eth0: adding route to 10.0.2.0/241100gitlab # [ 14.636475] dhcpcd[775]: eth0: adding default route via 10.0.2.21101gitlab # [ 14.757306] systemd[1]: Started DHCP Client.1102gitlab # [ 14.758707] systemd[1]: Reached target Network is Online.1103gitlab # [ 40.626805] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[926]: W, [2026-09-08T05:54:57.954381 #926] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1104gitlab # [ 42.371257] postgres[1317]: [1317] ERROR: relation "feature_gates" does not exist at character 5231105gitlab # [ 42.371500] postgres[1317]: [1317] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1106gitlab # [ 42.372602] postgres[1317]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1107gitlab # [ 42.374121] postgres[1317]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1108gitlab # [ 42.375230] postgres[1317]: attidentity AS identity,1109gitlab # [ 42.376362] postgres[1317]: attgenerated as attgenerated1110gitlab # [ 42.377841] postgres[1317]: FROM pg_attribute a1111gitlab # [ 42.378961] postgres[1317]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1112gitlab # [ 42.380450] postgres[1317]: LEFT JOIN pg_type t ON a.atttypid = t.oid1113gitlab # [ 42.381952] postgres[1317]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1114gitlab # [ 42.383451] postgres[1317]: WHERE a.attrelid = '"feature_gates"'::regclass1115gitlab # [ 42.384953] postgres[1317]: AND a.attnum > 0 AND NOT a.attisdropped1116gitlab # [ 42.386499] postgres[1317]: ORDER BY a.attnum1117gitlab # [ 42.388069] postgres[1317]:1118gitlab # [ 46.136152] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1351]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1119gitlab # [ 46.136388] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1351]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1120gitlab # [ 48.184453] gitlab-workhorse[834]: time="2026-09-08T05:55:05Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1121gitlab # [ 58.194667] gitlab-workhorse[834]: time="2026-09-08T05:55:15Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1122gitlab # [ 60.858993] postgres[1425]: [1425] ERROR: relation "table_without_models" does not exist1123gitlab # [ 60.859397] postgres[1425]: [1425] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1124gitlab # [ 68.203051] gitlab-workhorse[834]: time="2026-09-08T05:55:25Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1125gitlab # [ 72.326137] systemd[1]: Finished gitlab-db-config.service.1126gitlab # [ 72.329444] systemd[1]: Started gitlab-sidekiq.service.1127gitlab # [ 72.332765] systemd[1]: Starting gitlab.service...1128gitlab # [ 72.689321] bundle[1592]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1129gitlab # [ 72.690179] bundle[1592]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1130gitlab # [ 72.694184] bundle[1592]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1131gitlab # [ 75.341574] sidekiq-cluster[1591]: {"severity":"INFO","time":"2026-09-08T05:55:32.652Z","message":"Starting cluster with 1 processes"}1132gitlab # [ 75.490247] bundle[1592]: {"timestamp":"2026-09-08T05:55:32.798Z","pid":1592,"message":"* Enabling systemd notification integration"}1133gitlab # [ 75.490918] bundle[1592]: {"timestamp":"2026-09-08T05:55:32.818Z","pid":1592,"message":"Puma starting in cluster mode..."}1134gitlab # [ 75.491737] bundle[1592]: {"timestamp":"2026-09-08T05:55:32.818Z","pid":1592,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1135gitlab # [ 75.492509] bundle[1592]: {"timestamp":"2026-09-08T05:55:32.818Z","pid":1592,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1136gitlab # [ 75.493150] bundle[1592]: {"timestamp":"2026-09-08T05:55:32.818Z","pid":1592,"message":"* Min threads: 0"}1137gitlab # [ 75.493843] bundle[1592]: {"timestamp":"2026-09-08T05:55:32.818Z","pid":1592,"message":"* Max threads: 4"}1138gitlab # [ 75.494719] bundle[1592]: {"timestamp":"2026-09-08T05:55:32.818Z","pid":1592,"message":"* Environment: production"}1139gitlab # [ 75.495477] bundle[1592]: {"timestamp":"2026-09-08T05:55:32.818Z","pid":1592,"message":"* Master PID: 1592"}1140gitlab # [ 75.496185] bundle[1592]: {"timestamp":"2026-09-08T05:55:32.818Z","pid":1592,"message":"* Workers: 2"}1141gitlab # [ 75.496815] bundle[1592]: {"timestamp":"2026-09-08T05:55:32.818Z","pid":1592,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1142gitlab # [ 75.497620] bundle[1592]: {"timestamp":"2026-09-08T05:55:32.818Z","pid":1592,"message":"* Preloading application"}1143gitlab # [ 78.204849] gitlab-workhorse[834]: time="2026-09-08T05:55:35Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1144gitlab # [ 88.214981] gitlab-workhorse[834]: time="2026-09-08T05:55:45Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1145gitlab # [ 97.698382] bundle[1592]: W, [2026-09-08T05:55:55.026304 #1592] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1146gitlab # [ 98.224764] gitlab-workhorse[834]: time="2026-09-08T05:55:55Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1147gitlab # [ 100.105888] sidekiq-cluster[1613]: 2026-09-08T05:55:57.433Z pid=1613 tid=wkl INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1613, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>438743040}1148gitlab # [ 100.279681] sidekiq-cluster[1613]: W, [2026-09-08T05:55:57.607816 #1613] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1149gitlab # [ 100.321562] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:57.649Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1150gitlab # [ 102.196471] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.523Z","message":"GitLab reliable fetch activated!"}1151gitlab # [ 102.196944] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.523Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1152gitlab # [ 102.223091] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.551Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1153gitlab # [ 102.227439] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.555Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1154gitlab # [ 102.231813] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.560Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1155gitlab # [ 102.236356] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.564Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1156gitlab # [ 102.241152] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.569Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1157gitlab # [ 102.249268] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.577Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1158gitlab # [ 102.255514] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.583Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1159gitlab # [ 102.260393] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.588Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1160gitlab # [ 102.265606] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.593Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1161gitlab # [ 102.271083] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.599Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1162gitlab # [ 102.276334] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.604Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1163gitlab # [ 102.282345] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.610Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1164gitlab # [ 102.287382] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.615Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1165gitlab # [ 102.292313] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.620Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1166gitlab # [ 102.297444] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.625Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1167gitlab # [ 102.302936] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.631Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1168gitlab # [ 102.309355] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.637Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1169gitlab # [ 102.315141] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.643Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1170gitlab # [ 102.321136] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.649Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1171gitlab # [ 102.326934] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.655Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1172gitlab # [ 102.333097] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.661Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1173gitlab # [ 102.339192] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.667Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1174gitlab # [ 102.345091] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.673Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1175gitlab # [ 102.350461] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.678Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1176gitlab # [ 102.355948] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.684Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1177gitlab # [ 102.361930] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.690Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1178gitlab # [ 102.366940] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.695Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1179gitlab # [ 102.372192] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.700Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1180gitlab # [ 102.378267] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.706Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1181gitlab # [ 102.383633] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.711Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1182gitlab # [ 102.388302] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.716Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1183gitlab # [ 102.393872] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.722Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1184gitlab # [ 102.399522] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.727Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1185gitlab # [ 102.404890] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.733Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1186gitlab # [ 102.409760] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.738Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1187gitlab # [ 102.414330] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.742Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1188gitlab # [ 102.419231] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.747Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1189gitlab # [ 102.424123] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.752Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1190gitlab # [ 102.428523] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.756Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1191gitlab # [ 102.433352] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.761Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1192gitlab # [ 102.438345] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.766Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1193gitlab # [ 102.442786] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.771Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1194gitlab # [ 102.448388] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.776Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1195gitlab # [ 102.453871] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.782Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1196gitlab # [ 102.459557] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.787Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1197gitlab # [ 102.464891] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.793Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1198gitlab # [ 102.469309] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.797Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1199gitlab # [ 102.474092] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.802Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1200gitlab # [ 102.479184] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.807Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1201gitlab # [ 102.486695] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.814Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1202gitlab # [ 102.492213] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.820Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1203gitlab # [ 102.498625] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.826Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1204gitlab # [ 102.519090] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.847Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1205gitlab # [ 102.527598] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.855Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1206gitlab # [ 102.534670] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.862Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1207gitlab # [ 102.543727] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.871Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1208gitlab # [ 102.551707] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.879Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1209gitlab # [ 102.561506] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.889Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1210gitlab # [ 102.568772] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.897Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1211gitlab # [ 102.577126] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.905Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1212gitlab # [ 102.584273] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.912Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1213gitlab # [ 102.591429] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.919Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1214gitlab # [ 102.599717] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.928Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1215gitlab # [ 102.608295] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.936Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1216gitlab # [ 102.616117] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.944Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1217gitlab # [ 102.624438] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.952Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1218gitlab # [ 102.631350] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.959Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1219gitlab # [ 102.638553] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.966Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1220gitlab # [ 102.647294] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.975Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1221gitlab # [ 102.655348] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.983Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1222gitlab # [ 102.662841] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.991Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1223gitlab # [ 102.670120] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:55:59.998Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1224gitlab # [ 102.678136] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:00.006Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1225gitlab # [ 102.687752] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:00.016Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1226gitlab # [ 102.692913] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:00.020Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1227gitlab # [ 102.697291] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:00.025Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1228gitlab # [ 102.702300] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:00.030Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1229gitlab # [ 102.710082] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:00.037Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1230gitlab # [ 102.714372] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:00.042Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1231gitlab # [ 102.719887] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:00.047Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1232gitlab # [ 102.724139] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:00.052Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1233gitlab # [ 102.729167] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:00.057Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1234gitlab # [ 102.733161] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:00.061Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1235gitlab # [ 102.736722] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:00.065Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1236gitlab # [ 102.740077] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:00.068Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1237gitlab # [ 102.742143] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:00.070Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1238gitlab # [ 102.743826] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:00.072Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1239gitlab # [ 102.745386] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:00.073Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1240gitlab # [ 102.746847] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:00.075Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1241gitlab # [ 102.748347] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:00.076Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1242gitlab # [ 102.749759] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:00.078Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1243gitlab # [ 102.751114] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:00.079Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1244gitlab # [ 102.752564] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:00.080Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1245gitlab # [ 102.754074] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:00.082Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1246gitlab # [ 102.755887] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:00.084Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1247gitlab # [ 102.757769] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:00.086Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1248gitlab # [ 102.759325] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:00.087Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1249gitlab # [ 102.760980] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:00.089Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1250gitlab # [ 102.769484] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:00.097Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1251gitlab # [ 102.773202] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:00.101Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1252gitlab # [ 102.777636] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:00.105Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1253gitlab # [ 102.810798] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:00.138Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1254gitlab # [ 102.815602] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:00.143Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1255gitlab # [ 102.819703] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:00.148Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1256gitlab # [ 102.825392] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:00.153Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1257gitlab # [ 102.829062] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:00.157Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1258gitlab # [ 102.834861] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:00.163Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1259gitlab # [ 102.842621] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:00.170Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1260gitlab # [ 102.847706] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:00.176Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1261gitlab # [ 104.990886] sidekiq-cluster[1613]: InitializerConnections Query: SET client_min_messages TO 'warning'1262gitlab # [ 104.991773] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1263gitlab # [ 104.993674] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1264gitlab # [ 104.995303] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1265gitlab # [ 104.996574] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1266gitlab # [ 104.998220] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1267gitlab # [ 104.998942] sidekiq-cluster[1613]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1268gitlab # [ 105.012984] sidekiq-cluster[1613]: InitializerConnections Query: SET standard_conforming_strings = on1269gitlab # [ 105.014085] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1270gitlab # [ 105.015172] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1271gitlab # [ 105.016294] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1272gitlab # [ 105.017440] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1273gitlab # [ 105.018931] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1274gitlab # [ 105.019720] sidekiq-cluster[1613]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1275gitlab # [ 105.046100] sidekiq-cluster[1613]: InitializerConnections Query: SET intervalstyle = iso_86011276gitlab # [ 105.046349] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1277gitlab # [ 105.047219] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1278gitlab # [ 105.047948] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1279gitlab # [ 105.049054] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1280gitlab # [ 105.049798] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1281gitlab # [ 105.050896] sidekiq-cluster[1613]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1282gitlab # [ 105.077290] sidekiq-cluster[1613]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT t.oid, t.typname1283gitlab # [ 105.077879] sidekiq-cluster[1613]: FROM pg_type as t1284gitlab # [ 105.079153] sidekiq-cluster[1613]: WHERE t.typname IN ('int2', 'int4', 'int8', 'oid', 'float4', 'float8', 'numeric', 'bool', 'timestamp', 'timestamptz')1285gitlab # [ 105.080280] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1286gitlab # [ 105.081169] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1287gitlab # [ 105.082107] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1288gitlab # [ 105.083059] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1289gitlab # [ 105.083943] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1290gitlab # [ 105.084849] sidekiq-cluster[1613]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1291gitlab # [ 105.099960] sidekiq-cluster[1613]: InitializerConnections Query: SET SESSION timezone TO 'UTC'1292gitlab # [ 105.100510] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1293gitlab # [ 105.101194] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1294gitlab # [ 105.101819] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1295gitlab # [ 105.102950] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1296gitlab # [ 105.103702] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1297gitlab # [ 105.104493] sidekiq-cluster[1613]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1298gitlab # [ 105.110626] sidekiq-cluster[1613]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT "feature_gates"."key", "feature_gates"."value" FROM "feature_gates" WHERE "feature_gates"."feature_key" = 'per_thread_db_connection_pool_metrics'1299gitlab # [ 105.111275] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1300gitlab # [ 105.112072] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1301gitlab # [ 105.112861] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1302gitlab # [ 105.113696] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1303gitlab # [ 105.114478] sidekiq-cluster[1613]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1304gitlab # [ 105.115209] sidekiq-cluster[1613]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1305gitlab # [ 108.225875] gitlab-workhorse[834]: time="2026-09-08T05:56:05Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1306gitlab # [ 118.235917] gitlab-workhorse[834]: time="2026-09-08T05:56:15Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1307gitlab # [ 127.054643] postgres[2060]: [2060] ERROR: relation "table_without_models" does not exist1308gitlab # [ 127.055530] postgres[2060]: [2060] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1309gitlab # [ 128.137239] postgres[2071]: [2071] ERROR: relation "table_without_models" does not exist1310gitlab # [ 128.137535] postgres[2071]: [2071] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1311gitlab # [ 128.237439] gitlab-workhorse[834]: time="2026-09-08T05:56:25Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1312gitlab # [ 129.650068] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:26.977Z","message":"Booted Rails 7.2.3.1 application in production environment"}1313gitlab # [ 129.652520] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:26.980Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1314gitlab # [ 129.654396] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:26.980Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1315gitlab # [ 129.659171] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:26.980Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1316gitlab # [ 129.661212] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:26.985Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1317gitlab # [ 130.921308] bundle[1592]: {"timestamp":"2026-09-08T05:56:28.248Z","pid":1592,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1318gitlab # [ 130.921845] bundle[1592]: {"timestamp":"2026-09-08T05:56:28.248Z","pid":1592,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1319gitlab # [ 130.922745] bundle[1592]: {"timestamp":"2026-09-08T05:56:28.249Z","pid":1592,"message":"! #\u003cThread:0x0000752a857af920 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1320gitlab # [ 130.923779] bundle[1592]: {"timestamp":"2026-09-08T05:56:28.249Z","pid":1592,"message":"! #\u003cThread:0x0000752a85a6e030 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1321gitlab # [ 130.924473] bundle[1592]: {"timestamp":"2026-09-08T05:56:28.249Z","pid":1592,"message":"Use Ctrl-C to stop"}1322gitlab # [ 130.925175] bundle[1592]: {"timestamp":"2026-09-08T05:56:28.249Z","pid":1592,"message":"Sending status to systemd every 1.0 sec"}1323gitlab # [ 131.015091] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:28.343Z","message":"Cleaning working queues"}1324gitlab # [ 131.017778] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:28.345Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"fc09d4b6b3473cb8141f4922","created_at":"2026-09-08T05:55:29.370Z","trace_propagation_headers":{"sentry-trace":"a41b3792dfee4f3082cfb7abfe803abd-8f3133cc972e4b48","baggage":"sentry-trace_id=a41b3792dfee4f3082cfb7abfe803abd,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"05e41f2bf15115a38925c3d34e8e302f","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-08T05:55:29.378Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-fc09d4b6b3473cb8141f4922: start","job_status":"start","queue_duration_s":58.967809,"scheduling_latency_s":58.967849}1325gitlab # [ 131.144858] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:28.472Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"fc09d4b6b3473cb8141f4922","created_at":"2026-09-08T05:55:29.370Z","trace_propagation_headers":{"sentry-trace":"a41b3792dfee4f3082cfb7abfe803abd-8f3133cc972e4b48","baggage":"sentry-trace_id=a41b3792dfee4f3082cfb7abfe803abd,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"05e41f2bf15115a38925c3d34e8e302f","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-08T05:55:29.378Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-fc09d4b6b3473cb8141f4922: done: 0.127164 sec","job_status":"done","queue_duration_s":58.967809,"scheduling_latency_s":58.967849,"redis_calls":26,"redis_duration_s":0.0037010000000000003,"redis_read_bytes":914,"redis_write_bytes":2887,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.001967,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001066,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000668,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.065104364,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.127164,"completed_at":"2026-09-08T05:56:28.472Z","load_balancing_strategy":"primary","db_duration_s":0.032073,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1326gitlab # [ 131.246286] bundle[1592]: {"timestamp":"2026-09-08T05:56:28.574Z","pid":1592,"message":"- Worker 0 (PID: 2155) booted in 0.26s, phase: 0"}1327gitlab # [ 131.319971] bundle[1592]: {"timestamp":"2026-09-08T05:56:28.647Z","pid":1592,"message":"- Worker 1 (PID: 2159) booted in 0.31s, phase: 0"}1328gitlab # [ 131.326999] systemd[1]: Started gitlab.service.1329gitlab # [ 131.329209] systemd[1]: Reached target Common target for all GitLab services..1330gitlab # [ 131.332259] systemd[1]: Starting setup-gitlab.service...1331gitlab # [ 131.359539] setup-gitlab-start[2199]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1332gitlab # [ 133.763737] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:56:31 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 23741333gitlab # [ 133.767824] setup-gitlab-start[2199]: + TOKEN=nixbot-test-token-of-20-chars1334gitlab # [ 133.770497] setup-gitlab-start[2199]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1335gitlab # [ 133.780681] runuser[2217]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1336gitlab # [ 134.153828] setup-gitlab-start[2218]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1337gitlab # [ 134.154603] setup-gitlab-start[2218]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1338gitlab # [ 134.156179] setup-gitlab-start[2218]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1339gitlab # [ 134.728425] setup-gitlab-start[2218]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1340gitlab # [ 134.728845] setup-gitlab-start[2218]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1341gitlab # [ 134.730405] setup-gitlab-start[2218]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1342gitlab # [ 143.466248] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:40.793Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"98b24c62894b42f8e8d07228","created_at":"2026-09-08T05:56:40.760Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e5d53b62504a3462a24aebea5fcd473f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:40.791Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-98b24c62894b42f8e8d07228: start","job_status":"start","queue_duration_s":0.002427,"scheduling_latency_s":0.002462}1343gitlab # [ 143.518865] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:40.847Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1344gitlab # [ 143.569194] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:40.896Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"98b24c62894b42f8e8d07228","created_at":"2026-09-08T05:56:40.760Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e5d53b62504a3462a24aebea5fcd473f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:40.791Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-98b24c62894b42f8e8d07228: done: 0.103249 sec","job_status":"done","queue_duration_s":0.002427,"scheduling_latency_s":0.002462,"redis_calls":10,"redis_duration_s":0.011589,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001191,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008326,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002072,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019698,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.004117842,"duration_s":0.103249,"completed_at":"2026-09-08T05:56:40.896Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000696,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1345gitlab # [ 143.571397] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:40.899Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"6c7db8645bbf61c7d406869e","created_at":"2026-09-08T05:56:40.820Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"d96f5d682c431693605e079d574a74c9","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:40.837Z","job_size_bytes":3,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-6c7db8645bbf61c7d406869e: start","job_status":"start","queue_duration_s":0.061359,"scheduling_latency_s":0.061392}1346gitlab # [ 143.626996] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:40.923Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"6c7db8645bbf61c7d406869e","created_at":"2026-09-08T05:56:40.820Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"d96f5d682c431693605e079d574a74c9","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:40.837Z","job_size_bytes":3,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-6c7db8645bbf61c7d406869e: done: 0.023932 sec","job_status":"done","queue_duration_s":0.061359,"scheduling_latency_s":0.061392,"redis_calls":10,"redis_duration_s":0.003052,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000539,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001596,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000917,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012605,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000436369,"duration_s":0.023932,"completed_at":"2026-09-08T05:56:40.923Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000759,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1347gitlab # [ 143.691193] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.019Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"17074758dedaaca8a70d4b85","created_at":"2026-09-08T05:56:40.881Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7f2b174eb948a53ae31217cda378a7de","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.016Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-17074758dedaaca8a70d4b85: start","job_status":"start","queue_duration_s":0.002266,"scheduling_latency_s":0.002312}1348gitlab # [ 143.782270] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.109Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"17074758dedaaca8a70d4b85","created_at":"2026-09-08T05:56:40.881Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7f2b174eb948a53ae31217cda378a7de","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.016Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-17074758dedaaca8a70d4b85: done: 0.090796 sec","job_status":"done","queue_duration_s":0.002266,"scheduling_latency_s":0.002312,"redis_calls":19,"redis_duration_s":0.022937,"redis_read_bytes":21,"redis_write_bytes":4781,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.004684,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000683,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3011,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.010463,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.007107,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038417,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001970083,"duration_s":0.090796,"completed_at":"2026-09-08T05:56:41.109Z","load_balancing_strategy":"primary","db_duration_s":0.0132,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1349gitlab # [ 143.842365] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.116Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"d31265ea988404e9b66e1f7d","created_at":"2026-09-08T05:56:41.036Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"219b7969f186106bab8c0e6e5813c0a5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.055Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-d31265ea988404e9b66e1f7d: start","job_status":"start","queue_duration_s":0.060363,"scheduling_latency_s":0.0604}1350gitlab # [ 143.875125] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.203Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"d31265ea988404e9b66e1f7d","created_at":"2026-09-08T05:56:41.036Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"219b7969f186106bab8c0e6e5813c0a5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.055Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-d31265ea988404e9b66e1f7d: done: 0.087095 sec","job_status":"done","queue_duration_s":0.060363,"scheduling_latency_s":0.0604,"redis_calls":12,"redis_duration_s":0.023164999999999998,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.005317,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.015413,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002435,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.034,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015053,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.002265092,"duration_s":0.087095,"completed_at":"2026-09-08T05:56:41.202Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.033536,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1351gitlab # [ 143.920469] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.248Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"9a30e586abc00b6e1b592357","created_at":"2026-09-08T05:56:41.068Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ca8648c33a72e42a5c18ade4a3e86698","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.085Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-9a30e586abc00b6e1b592357: start","job_status":"start","queue_duration_s":0.162471,"scheduling_latency_s":0.162498}1352gitlab # [ 144.087528] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.415Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"9a30e586abc00b6e1b592357","created_at":"2026-09-08T05:56:41.068Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ca8648c33a72e42a5c18ade4a3e86698","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.085Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-9a30e586abc00b6e1b592357: done: 0.166897 sec","job_status":"done","queue_duration_s":0.162471,"scheduling_latency_s":0.162498,"redis_calls":12,"redis_duration_s":0.015476,"redis_read_bytes":11,"redis_write_bytes":1447,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001411,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":319,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.009845,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00422,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":542,"db_count":101,"db_write_count":0,"db_cached_count":99,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":101,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":99,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":100,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":99,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.099029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.002142172,"exclusive_lock_hold_duration_s":0.113457995,"extra.ci_update_locked_unknown_artifacts_worker.removed_count":0,"extra.ci_update_locked_unknown_artifacts_worker.locked_count":0,"duration_s":0.166897,"completed_at":"2026-09-08T05:56:41.415Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.030914,"urgency":"throttled","target_duration_s":300,"target_scheduling_latency_s":null}1353gitlab # [ 144.160836] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.422Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"419f19ba07e6ed39f832d876","created_at":"2026-09-08T05:56:41.058Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-7a96b9a1f8184bd4","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"7f2b174eb948a53ae31217cda378a7de","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.090Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-419f19ba07e6ed39f832d876: start","job_status":"start","queue_duration_s":0.331462,"scheduling_latency_s":0.33148}1354gitlab # [ 144.171780] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.486Z","message":"No existing merge request to be cleaned up."}1355gitlab # [ 144.181596] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.509Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"419f19ba07e6ed39f832d876","created_at":"2026-09-08T05:56:41.058Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-7a96b9a1f8184bd4","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"7f2b174eb948a53ae31217cda378a7de","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.090Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-419f19ba07e6ed39f832d876: done: 0.08693 sec","job_status":"done","queue_duration_s":0.331462,"scheduling_latency_s":0.33148,"redis_calls":13,"redis_duration_s":0.031256,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00094,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.019321,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.010995,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019352,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00171195,"duration_s":0.08693,"completed_at":"2026-09-08T05:56:41.509Z","load_balancing_strategy":"primary","db_duration_s":0.004171,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356gitlab # [ 144.201914] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.514Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c52ece054ba7febfaeeb173b","created_at":"2026-09-08T05:56:41.058Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-7a96b9a1f8184bd4","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"7f2b174eb948a53ae31217cda378a7de","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.090Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c52ece054ba7febfaeeb173b: start","job_status":"start","queue_duration_s":0.423143,"scheduling_latency_s":0.42316}1357gitlab # [ 144.224670] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.553Z","message":"No existing merge request to be cleaned up."}1358gitlab # [ 144.238338] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.566Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c52ece054ba7febfaeeb173b","created_at":"2026-09-08T05:56:41.058Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-7a96b9a1f8184bd4","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"7f2b174eb948a53ae31217cda378a7de","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.090Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c52ece054ba7febfaeeb173b: done: 0.052325 sec","job_status":"done","queue_duration_s":0.423143,"scheduling_latency_s":0.42316,"redis_calls":10,"redis_duration_s":0.008164,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004979,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003185,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.008,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.008,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010489,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.052325,"completed_at":"2026-09-08T05:56:41.566Z","load_balancing_strategy":"primary","db_duration_s":0.010739,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1359gitlab # [ 144.239313] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.567Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1fa76ff48c1d89335e5fd7b7","created_at":"2026-09-08T05:56:41.058Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-7a96b9a1f8184bd4","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"7f2b174eb948a53ae31217cda378a7de","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.090Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1fa76ff48c1d89335e5fd7b7: start","job_status":"start","queue_duration_s":0.476587,"scheduling_latency_s":0.476602}1360gitlab # [ 144.247122] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.575Z","message":"No existing merge request to be cleaned up."}1361gitlab # [ 144.253175] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.581Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1fa76ff48c1d89335e5fd7b7","created_at":"2026-09-08T05:56:41.058Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-7a96b9a1f8184bd4","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"7f2b174eb948a53ae31217cda378a7de","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.090Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1fa76ff48c1d89335e5fd7b7: done: 0.013717 sec","job_status":"done","queue_duration_s":0.476587,"scheduling_latency_s":0.476602,"redis_calls":10,"redis_duration_s":0.0016649999999999998,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000726,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000939,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009122,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013717,"completed_at":"2026-09-08T05:56:41.581Z","load_balancing_strategy":"primary","db_duration_s":0.001345,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1362gitlab # [ 144.305246] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.582Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b78671930eb78c4c0b94074a","created_at":"2026-09-08T05:56:41.058Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-7a96b9a1f8184bd4","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"7f2b174eb948a53ae31217cda378a7de","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.090Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b78671930eb78c4c0b94074a: start","job_status":"start","queue_duration_s":0.491468,"scheduling_latency_s":0.491485}1363gitlab # [ 144.305896] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.592Z","message":"No existing merge request to be cleaned up."}1364gitlab # [ 144.306462] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.598Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b78671930eb78c4c0b94074a","created_at":"2026-09-08T05:56:41.058Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-7a96b9a1f8184bd4","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"7f2b174eb948a53ae31217cda378a7de","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.090Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b78671930eb78c4c0b94074a: done: 0.016256 sec","job_status":"done","queue_duration_s":0.491468,"scheduling_latency_s":0.491485,"redis_calls":10,"redis_duration_s":0.001349,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000813,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008213,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016256,"completed_at":"2026-09-08T05:56:41.598Z","load_balancing_strategy":"primary","db_duration_s":0.00691,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1365gitlab # [ 144.352573] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.599Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"e76d90a0d65b941d9b6c87a0","created_at":"2026-09-08T05:56:41.097Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b9bff1df92103ee6ac2b0ed5a3d37bc1","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.115Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-e76d90a0d65b941d9b6c87a0: start","job_status":"start","queue_duration_s":0.484653,"scheduling_latency_s":0.484668}1366gitlab # [ 144.353305] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.619Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"e76d90a0d65b941d9b6c87a0","created_at":"2026-09-08T05:56:41.097Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b9bff1df92103ee6ac2b0ed5a3d37bc1","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.115Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-e76d90a0d65b941d9b6c87a0: done: 0.020213 sec","job_status":"done","queue_duration_s":0.484653,"scheduling_latency_s":0.484668,"redis_calls":13,"redis_duration_s":0.001722,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000282,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000878,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000562,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012954,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.006501664,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.020213,"completed_at":"2026-09-08T05:56:41.619Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002174,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1367gitlab # [ 144.377224] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.620Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"8f34f153f0330cea8b2c48b4","created_at":"2026-09-08T05:56:41.140Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b76869421a0a792f6b98cf3283e042f2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.152Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-8f34f153f0330cea8b2c48b4: start","job_status":"start","queue_duration_s":0.468439,"scheduling_latency_s":0.468452}1368gitlab # [ 144.424954] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.628Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1369gitlab # [ 144.425667] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.633Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"8f34f153f0330cea8b2c48b4","created_at":"2026-09-08T05:56:41.140Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b76869421a0a792f6b98cf3283e042f2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.152Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-8f34f153f0330cea8b2c48b4: done: 0.012342 sec","job_status":"done","queue_duration_s":0.468439,"scheduling_latency_s":0.468452,"redis_calls":10,"redis_duration_s":0.001356,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000262,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000734,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00036,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007106,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000194718,"duration_s":0.012342,"completed_at":"2026-09-08T05:56:41.633Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000231,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1370gitlab # [ 144.432118] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.634Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"89e56b745a09478db5b24709","created_at":"2026-09-08T05:56:41.184Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ac33e1c42b269ddb98c887c289e7cb3b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.195Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-89e56b745a09478db5b24709: start","job_status":"start","queue_duration_s":0.438458,"scheduling_latency_s":0.438472}1371gitlab # [ 144.442217] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.653Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"89e56b745a09478db5b24709","created_at":"2026-09-08T05:56:41.184Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ac33e1c42b269ddb98c887c289e7cb3b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.195Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-89e56b745a09478db5b24709: done: 0.019362 sec","job_status":"done","queue_duration_s":0.438458,"scheduling_latency_s":0.438472,"redis_calls":12,"redis_duration_s":0.00171,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000249,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000883,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000578,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009884,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000339708,"exclusive_lock_hold_duration_s":0.006182071,"duration_s":0.019362,"completed_at":"2026-09-08T05:56:41.653Z","load_balancing_strategy":"primary","db_duration_s":0.004476,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1372gitlab # [ 144.487060] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.654Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"cae8ed9e0d007951e71d96e7","created_at":"2026-09-08T05:56:41.246Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fe54527d0b832f969613425e2dceb57c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.258Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-cae8ed9e0d007951e71d96e7: start","job_status":"start","queue_duration_s":0.396242,"scheduling_latency_s":0.396255}1373gitlab # [ 144.493354] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.779Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"cae8ed9e0d007951e71d96e7","created_at":"2026-09-08T05:56:41.246Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fe54527d0b832f969613425e2dceb57c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.258Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-cae8ed9e0d007951e71d96e7: done: 0.125456 sec","job_status":"done","queue_duration_s":0.396242,"scheduling_latency_s":0.396255,"redis_calls":12,"redis_duration_s":0.002626,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000244,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000732,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00165,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.082,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.082,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025791,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001721448,"exclusive_lock_hold_duration_s":0.039130671000000006,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.125456,"completed_at":"2026-09-08T05:56:41.779Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.08645,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1374gitlab # [ 144.537123] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.781Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"c6b6decc4ebedf05938edfaa","created_at":"2026-09-08T05:56:41.274Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"126b43a9249539297c59f600ad5afe60","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.290Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-c6b6decc4ebedf05938edfaa: start","job_status":"start","queue_duration_s":0.490507,"scheduling_latency_s":0.490524}1375gitlab # [ 144.543892] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.858Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"c6b6decc4ebedf05938edfaa","created_at":"2026-09-08T05:56:41.274Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"126b43a9249539297c59f600ad5afe60","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.290Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-c6b6decc4ebedf05938edfaa: done: 0.07709 sec","job_status":"done","queue_duration_s":0.490507,"scheduling_latency_s":0.490524,"redis_calls":14,"redis_duration_s":0.005239,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000751,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003309,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001179,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.016,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017231,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000928331,"exclusive_lock_hold_duration_s":0.035679116000000004,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.07709,"completed_at":"2026-09-08T05:56:41.858Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026001,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1376gitlab # [ 144.597246] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.859Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"920115a8b64033feaa9b9e3c","created_at":"2026-09-08T05:56:41.312Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dfd97cd1bebf3bbcf507c7c3439f12f6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-08T05:56:41.329Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-920115a8b64033feaa9b9e3c: start","job_status":"start","queue_duration_s":0.529921,"scheduling_latency_s":0.529937}1377gitlab # [ 144.597928] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.868Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1378gitlab # [ 144.598571] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.873Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"920115a8b64033feaa9b9e3c","created_at":"2026-09-08T05:56:41.312Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dfd97cd1bebf3bbcf507c7c3439f12f6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-08T05:56:41.329Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-920115a8b64033feaa9b9e3c: done: 0.013579 sec","job_status":"done","queue_duration_s":0.529921,"scheduling_latency_s":0.529937,"redis_calls":10,"redis_duration_s":0.001264,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000255,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00076,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000249,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007147,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000358984,"duration_s":0.013579,"completed_at":"2026-09-08T05:56:41.873Z","load_balancing_strategy":"primary","db_duration_s":0.001091,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379gitlab # [ 144.635610] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.874Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"dbce64a154b37596943fcaa3","created_at":"2026-09-08T05:56:41.412Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cfa0b798eff11128d48685b1aba1a65c","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.424Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-dbce64a154b37596943fcaa3: start","job_status":"start","queue_duration_s":0.450001,"scheduling_latency_s":0.450014}1380gitlab # [ 144.677585] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.894Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"dbce64a154b37596943fcaa3","created_at":"2026-09-08T05:56:41.412Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cfa0b798eff11128d48685b1aba1a65c","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.424Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-dbce64a154b37596943fcaa3: done: 0.019873 sec","job_status":"done","queue_duration_s":0.450001,"scheduling_latency_s":0.450014,"redis_calls":16,"redis_duration_s":0.002168,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.000988,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00089,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00029,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011414,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000205892,"duration_s":0.019873,"completed_at":"2026-09-08T05:56:41.894Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003035,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1381gitlab # [ 144.684746] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.895Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"29d2ec0fa9c9e6d46e7df29a","created_at":"2026-09-08T05:56:41.430Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1eff5dccee75329962759ceed380a967","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-08T05:56:41.437Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-29d2ec0fa9c9e6d46e7df29a: start","job_status":"start","queue_duration_s":0.457402,"scheduling_latency_s":0.457415}1382gitlab # [ 144.696700] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.902Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1383gitlab # [ 144.699658] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.907Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"29d2ec0fa9c9e6d46e7df29a","created_at":"2026-09-08T05:56:41.430Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1eff5dccee75329962759ceed380a967","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-08T05:56:41.437Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-29d2ec0fa9c9e6d46e7df29a: done: 0.011998 sec","job_status":"done","queue_duration_s":0.457402,"scheduling_latency_s":0.457415,"redis_calls":10,"redis_duration_s":0.001431,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000253,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000882,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000296,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006696,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000353956,"duration_s":0.011998,"completed_at":"2026-09-08T05:56:41.907Z","load_balancing_strategy":"primary","db_duration_s":0.000373,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1384gitlab # [ 144.757614] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.908Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"e4793d9047c1c8da04122e28","created_at":"2026-09-08T05:56:41.446Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e23c9ec772a64a2745fdbd507b24e046","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.457Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-e4793d9047c1c8da04122e28: start","job_status":"start","queue_duration_s":0.450793,"scheduling_latency_s":0.450806}1385gitlab # [ 144.758391] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.915Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1386gitlab # [ 144.758912] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.919Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"e4793d9047c1c8da04122e28","created_at":"2026-09-08T05:56:41.446Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e23c9ec772a64a2745fdbd507b24e046","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.457Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-e4793d9047c1c8da04122e28: done: 0.011545 sec","job_status":"done","queue_duration_s":0.450793,"scheduling_latency_s":0.450806,"redis_calls":10,"redis_duration_s":0.001325,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000241,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000852,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000232,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00648,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000217625,"duration_s":0.011545,"completed_at":"2026-09-08T05:56:41.919Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000256,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1387gitlab # [ 144.788727] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.920Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"ad35c5a2c97e3eea3e5ac2b3","created_at":"2026-09-08T05:56:41.470Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2cf5da9f0c1d27743b5d6c7b159bc932","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.492Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-ad35c5a2c97e3eea3e5ac2b3: start","job_status":"start","queue_duration_s":0.428008,"scheduling_latency_s":0.42802}1388gitlab # [ 144.837629] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.935Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"ad35c5a2c97e3eea3e5ac2b3","created_at":"2026-09-08T05:56:41.470Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2cf5da9f0c1d27743b5d6c7b159bc932","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.492Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-ad35c5a2c97e3eea3e5ac2b3: done: 0.014545 sec","job_status":"done","queue_duration_s":0.428008,"scheduling_latency_s":0.42802,"redis_calls":12,"redis_duration_s":0.0016640000000000001,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000316,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000291,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000777,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00028,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007069,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000206172,"duration_s":0.014545,"completed_at":"2026-09-08T05:56:41.935Z","load_balancing_strategy":"primary","db_duration_s":0.001954,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1389gitlab # [ 144.838609] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.936Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"5ab5015305d0848a2fb78b71","created_at":"2026-09-08T05:56:41.502Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dc115086ee61cd061b3264b67181e31a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.511Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-5ab5015305d0848a2fb78b71: start","job_status":"start","queue_duration_s":0.424163,"scheduling_latency_s":0.424175}1390gitlab # [ 144.885242] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.943Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1391gitlab # [ 144.885938] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.948Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"5ab5015305d0848a2fb78b71","created_at":"2026-09-08T05:56:41.502Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dc115086ee61cd061b3264b67181e31a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.511Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-5ab5015305d0848a2fb78b71: done: 0.012052 sec","job_status":"done","queue_duration_s":0.424163,"scheduling_latency_s":0.424175,"redis_calls":10,"redis_duration_s":0.0012799999999999999,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000245,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000781,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000254,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00666,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000206172,"duration_s":0.012052,"completed_at":"2026-09-08T05:56:41.948Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000244,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 144.891714] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.948Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"3b6d558af3d4a5c719da21fc","created_at":"2026-09-08T05:56:41.533Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d42697a914a05d060750a2d26f3748d7","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.542Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-3b6d558af3d4a5c719da21fc: start","job_status":"start","queue_duration_s":0.406361,"scheduling_latency_s":0.406374}1393gitlab # [ 144.938824] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.964Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"3b6d558af3d4a5c719da21fc","created_at":"2026-09-08T05:56:41.533Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d42697a914a05d060750a2d26f3748d7","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.542Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-3b6d558af3d4a5c719da21fc: done: 0.015629 sec","job_status":"done","queue_duration_s":0.406361,"scheduling_latency_s":0.406374,"redis_calls":10,"redis_duration_s":0.001307,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000253,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000803,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000251,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008953,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000201702,"duration_s":0.015629,"completed_at":"2026-09-08T05:56:41.964Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001695,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 144.941180] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:41.965Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"062cdaa2446f30dbe7390fc4","created_at":"2026-09-08T05:56:41.551Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.556Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-062cdaa2446f30dbe7390fc4: start","job_status":"start","queue_duration_s":0.40877,"scheduling_latency_s":0.408783}1395gitlab # [ 144.953474] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.049Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"062cdaa2446f30dbe7390fc4","created_at":"2026-09-08T05:56:41.551Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.556Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-062cdaa2446f30dbe7390fc4: done: 0.084558 sec","job_status":"done","queue_duration_s":0.40877,"scheduling_latency_s":0.408783,"redis_calls":71,"redis_duration_s":0.009759,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.001418,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000634,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.00732,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000387,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053802,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000225448,"duration_s":0.084558,"completed_at":"2026-09-08T05:56:42.049Z","load_balancing_strategy":"primary","db_duration_s":0.001054,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396gitlab # [ 144.993081] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.051Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"de212bc638f277917aa9c1ef","created_at":"2026-09-08T05:56:41.564Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5accabaa98031b8097f8e101bad44cd9","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.733Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-de212bc638f277917aa9c1ef: start","job_status":"start","queue_duration_s":0.318162,"scheduling_latency_s":0.318179}1397gitlab # [ 145.003590] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.077Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"de212bc638f277917aa9c1ef","created_at":"2026-09-08T05:56:41.564Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5accabaa98031b8097f8e101bad44cd9","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.733Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-de212bc638f277917aa9c1ef: done: 0.025943 sec","job_status":"done","queue_duration_s":0.318162,"scheduling_latency_s":0.318179,"redis_calls":10,"redis_duration_s":0.001506,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000261,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000968,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000277,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012284,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000235225,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.025943,"completed_at":"2026-09-08T05:56:42.077Z","load_balancing_strategy":"primary","db_duration_s":0.008332,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398gitlab # [ 145.064809] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.078Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"5257191b6688b0ccfcb4ce8b","created_at":"2026-09-08T05:56:41.747Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"43d13226bc3402451cdd98797ba61ca7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-08T05:56:41.761Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-5257191b6688b0ccfcb4ce8b: start","job_status":"start","queue_duration_s":0.317156,"scheduling_latency_s":0.31717}1399gitlab # [ 145.065669] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.101Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"5257191b6688b0ccfcb4ce8b","created_at":"2026-09-08T05:56:41.747Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"43d13226bc3402451cdd98797ba61ca7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-08T05:56:41.761Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-5257191b6688b0ccfcb4ce8b: done: 0.022745 sec","job_status":"done","queue_duration_s":0.317156,"scheduling_latency_s":0.31717,"redis_calls":10,"redis_duration_s":0.001306,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000303,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00075,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000253,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013727,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000207289,"duration_s":0.022745,"completed_at":"2026-09-08T05:56:42.101Z","load_balancing_strategy":"primary","db_duration_s":0.003623,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400gitlab # [ 145.112821] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.102Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"b0da45a51edfe11c9e482b54","created_at":"2026-09-08T05:56:41.766Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"44ab75312952459fb9424824c1113940","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.776Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-b0da45a51edfe11c9e482b54: start","job_status":"start","queue_duration_s":0.325392,"scheduling_latency_s":0.325406}1401gitlab # [ 145.113695] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.118Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"b0da45a51edfe11c9e482b54","created_at":"2026-09-08T05:56:41.766Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"44ab75312952459fb9424824c1113940","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.776Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-b0da45a51edfe11c9e482b54: done: 0.01642 sec","job_status":"done","queue_duration_s":0.325392,"scheduling_latency_s":0.325406,"redis_calls":10,"redis_duration_s":0.001387,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000278,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000847,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000262,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009739,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000210362,"duration_s":0.01642,"completed_at":"2026-09-08T05:56:42.118Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001712,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402gitlab # [ 145.160287] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.119Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"0fd3024357d2535a5ed06f8a","created_at":"2026-09-08T05:56:41.779Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4c1141e613a3680bc90eef3e7ab0cf8a","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.784Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-0fd3024357d2535a5ed06f8a: start","job_status":"start","queue_duration_s":0.335003,"scheduling_latency_s":0.335017}1403gitlab # [ 145.161187] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.134Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"0fd3024357d2535a5ed06f8a","created_at":"2026-09-08T05:56:41.779Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4c1141e613a3680bc90eef3e7ab0cf8a","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.784Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-0fd3024357d2535a5ed06f8a: done: 0.014928 sec","job_status":"done","queue_duration_s":0.335003,"scheduling_latency_s":0.335017,"redis_calls":12,"redis_duration_s":0.001776,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000282,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000767,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000727,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008495,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000485537,"exclusive_lock_hold_duration_s":0.002681067,"duration_s":0.014928,"completed_at":"2026-09-08T05:56:42.134Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001297,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 145.210613] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.135Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"a900b1b3d52a5f45f943972e","created_at":"2026-09-08T05:56:41.795Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a1cda17ee83c5ca6099ce3bffd9d23b5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.800Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-a900b1b3d52a5f45f943972e: start","job_status":"start","queue_duration_s":0.334775,"scheduling_latency_s":0.334788}1405gitlab # [ 145.211711] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.147Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"a900b1b3d52a5f45f943972e","created_at":"2026-09-08T05:56:41.795Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a1cda17ee83c5ca6099ce3bffd9d23b5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.800Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-a900b1b3d52a5f45f943972e: done: 0.012229 sec","job_status":"done","queue_duration_s":0.334775,"scheduling_latency_s":0.334788,"redis_calls":10,"redis_duration_s":0.001253,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000258,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000743,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000252,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007088,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000209523,"duration_s":0.012229,"completed_at":"2026-09-08T05:56:42.147Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000225,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 145.255816] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.148Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"4cd22f183a164846efff683d","created_at":"2026-09-08T05:56:41.809Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d86977e3ae3c45ab3876d0b95e3f1b55","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.821Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-4cd22f183a164846efff683d: start","job_status":"start","queue_duration_s":0.327207,"scheduling_latency_s":0.327219}1407gitlab # [ 145.256787] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.162Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"4cd22f183a164846efff683d","created_at":"2026-09-08T05:56:41.809Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d86977e3ae3c45ab3876d0b95e3f1b55","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.821Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-4cd22f183a164846efff683d: done: 0.01362 sec","job_status":"done","queue_duration_s":0.327207,"scheduling_latency_s":0.327219,"redis_calls":12,"redis_duration_s":0.001567,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000245,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00074,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000582,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007607,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000336635,"exclusive_lock_hold_duration_s":0.001919239,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.01362,"completed_at":"2026-09-08T05:56:42.162Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000863,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408gitlab # [ 145.293929] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.163Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"f0945599512d36d25566427f","created_at":"2026-09-08T05:56:41.828Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b2f8f6dd4af15645125f81385303a728","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.834Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-f0945599512d36d25566427f: start","job_status":"start","queue_duration_s":0.32943,"scheduling_latency_s":0.329444}1409gitlab # [ 145.306465] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.388Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"f0945599512d36d25566427f","created_at":"2026-09-08T05:56:41.828Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b2f8f6dd4af15645125f81385303a728","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.834Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-f0945599512d36d25566427f: done: 0.224435 sec","job_status":"done","queue_duration_s":0.32943,"scheduling_latency_s":0.329444,"redis_calls":565,"redis_duration_s":0.062009,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000241,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000779,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.060989,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.18181,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000234108,"duration_s":0.224435,"completed_at":"2026-09-08T05:56:42.387Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000238,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410gitlab # [ 145.344068] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.389Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"4714d921404eaf0f77fe2fd6","created_at":"2026-09-08T05:56:41.842Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9f8d148b5f0dac5ad318279ad1cb912b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.847Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-4714d921404eaf0f77fe2fd6: start","job_status":"start","queue_duration_s":0.541447,"scheduling_latency_s":0.541462}1411gitlab # [ 145.356731] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.529Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"4714d921404eaf0f77fe2fd6","created_at":"2026-09-08T05:56:41.842Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9f8d148b5f0dac5ad318279ad1cb912b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-08T05:56:41.847Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-4714d921404eaf0f77fe2fd6: done: 0.140469 sec","job_status":"done","queue_duration_s":0.541447,"scheduling_latency_s":0.541462,"redis_calls":14,"redis_duration_s":0.002422,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000501,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00096,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000961,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.099552,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000354514,"exclusive_lock_hold_duration_s":0.123790034,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.140469,"completed_at":"2026-09-08T05:56:42.529Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.042587,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1412gitlab # [ 145.396379] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.531Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e9f8edf4078789eacc96cd6","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e9f8edf4078789eacc96cd6: start","job_status":"start","queue_duration_s":0.506067,"scheduling_latency_s":0.506082}1413gitlab # [ 145.437765] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.547Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e9f8edf4078789eacc96cd6","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e9f8edf4078789eacc96cd6: done: 0.016815 sec","job_status":"done","queue_duration_s":0.506067,"scheduling_latency_s":0.506082,"redis_calls":16,"redis_duration_s":0.003157,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000412,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001408,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001337,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009257,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000205333,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016815,"completed_at":"2026-09-08T05:56:42.547Z","load_balancing_strategy":"primary","db_duration_s":0.000479,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1414gitlab # [ 145.442107] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.549Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8484f8cc3d0d443bf41dd4c5","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8484f8cc3d0d443bf41dd4c5: start","job_status":"start","queue_duration_s":0.524072,"scheduling_latency_s":0.524084}1415gitlab # [ 145.487929] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.560Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8484f8cc3d0d443bf41dd4c5","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8484f8cc3d0d443bf41dd4c5: done: 0.011067 sec","job_status":"done","queue_duration_s":0.524072,"scheduling_latency_s":0.524084,"redis_calls":13,"redis_duration_s":0.002804,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000834,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00197,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006565,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011067,"completed_at":"2026-09-08T05:56:42.560Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1416gitlab # [ 145.488932] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.561Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e07a684dedb88f2df50c625","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e07a684dedb88f2df50c625: start","job_status":"start","queue_duration_s":0.536339,"scheduling_latency_s":0.536353}1417gitlab # [ 145.499519] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.572Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e07a684dedb88f2df50c625","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e07a684dedb88f2df50c625: done: 0.010887 sec","job_status":"done","queue_duration_s":0.536339,"scheduling_latency_s":0.536353,"redis_calls":13,"redis_duration_s":0.002955,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001902,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006336,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010887,"completed_at":"2026-09-08T05:56:42.572Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1418gitlab # [ 145.534641] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.573Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f79413960b996fe6185ba01e","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f79413960b996fe6185ba01e: start","job_status":"start","queue_duration_s":0.548398,"scheduling_latency_s":0.54841}1419gitlab # [ 145.545626] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.584Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f79413960b996fe6185ba01e","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f79413960b996fe6185ba01e: done: 0.01088 sec","job_status":"done","queue_duration_s":0.548398,"scheduling_latency_s":0.54841,"redis_calls":13,"redis_duration_s":0.002589,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000805,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001784,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006336,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01088,"completed_at":"2026-09-08T05:56:42.584Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1420gitlab # [ 145.606762] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.587Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cafd83ed77b67dc81da60dca","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cafd83ed77b67dc81da60dca: start","job_status":"start","queue_duration_s":0.562376,"scheduling_latency_s":0.562391}1421gitlab # [ 145.607613] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.597Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cafd83ed77b67dc81da60dca","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cafd83ed77b67dc81da60dca: done: 0.009733 sec","job_status":"done","queue_duration_s":0.562376,"scheduling_latency_s":0.562391,"redis_calls":13,"redis_duration_s":0.00163,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001074,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00615,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009733,"completed_at":"2026-09-08T05:56:42.597Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1422gitlab # [ 145.625759] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.598Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a5363426d3e58f8021c6117","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a5363426d3e58f8021c6117: start","job_status":"start","queue_duration_s":0.573133,"scheduling_latency_s":0.573146}1423gitlab # [ 145.637593] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.607Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a5363426d3e58f8021c6117","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a5363426d3e58f8021c6117: done: 0.009781 sec","job_status":"done","queue_duration_s":0.573133,"scheduling_latency_s":0.573146,"redis_calls":13,"redis_duration_s":0.001531,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000998,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006067,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009781,"completed_at":"2026-09-08T05:56:42.607Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1424gitlab # [ 145.687227] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.608Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b0ac0cf25ebf74411bcb651","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b0ac0cf25ebf74411bcb651: start","job_status":"start","queue_duration_s":0.583896,"scheduling_latency_s":0.583909}1425gitlab # [ 145.687917] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.618Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b0ac0cf25ebf74411bcb651","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b0ac0cf25ebf74411bcb651: done: 0.009586 sec","job_status":"done","queue_duration_s":0.583896,"scheduling_latency_s":0.583909,"redis_calls":13,"redis_duration_s":0.001549,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000502,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001047,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006153,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009586,"completed_at":"2026-09-08T05:56:42.618Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426gitlab # [ 145.729804] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.619Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"467dbdff816b21f9ef359882","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-467dbdff816b21f9ef359882: start","job_status":"start","queue_duration_s":0.594441,"scheduling_latency_s":0.594455}1427gitlab # [ 145.730735] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.629Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"467dbdff816b21f9ef359882","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-467dbdff816b21f9ef359882: done: 0.009809 sec","job_status":"done","queue_duration_s":0.594441,"scheduling_latency_s":0.594455,"redis_calls":13,"redis_duration_s":0.00165,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001101,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006387,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009809,"completed_at":"2026-09-08T05:56:42.629Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428gitlab # [ 145.781220] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.630Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2b06b56b8e6e7fddafaaeb8","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2b06b56b8e6e7fddafaaeb8: start","job_status":"start","queue_duration_s":0.605421,"scheduling_latency_s":0.605435}1429gitlab # [ 145.781905] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.689Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2b06b56b8e6e7fddafaaeb8","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2b06b56b8e6e7fddafaaeb8: done: 0.059428 sec","job_status":"done","queue_duration_s":0.605421,"scheduling_latency_s":0.605435,"redis_calls":13,"redis_duration_s":0.001571,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001037,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053882,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.059428,"completed_at":"2026-09-08T05:56:42.689Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 145.809823] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.690Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"008ec9e4aca28abd7318c6d2","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-008ec9e4aca28abd7318c6d2: start","job_status":"start","queue_duration_s":0.666018,"scheduling_latency_s":0.666034}1431gitlab # [ 145.820977] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.701Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"008ec9e4aca28abd7318c6d2","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-008ec9e4aca28abd7318c6d2: done: 0.010854 sec","job_status":"done","queue_duration_s":0.666018,"scheduling_latency_s":0.666034,"redis_calls":13,"redis_duration_s":0.0016020000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00107,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007073,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010854,"completed_at":"2026-09-08T05:56:42.701Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432gitlab # [ 145.856767] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.702Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa680ecab301a6faa5528381","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa680ecab301a6faa5528381: start","job_status":"start","queue_duration_s":0.677747,"scheduling_latency_s":0.677762}1433gitlab # [ 145.867671] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.711Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa680ecab301a6faa5528381","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa680ecab301a6faa5528381: done: 0.009102 sec","job_status":"done","queue_duration_s":0.677747,"scheduling_latency_s":0.677762,"redis_calls":13,"redis_duration_s":0.001644,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000564,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00108,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00568,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009102,"completed_at":"2026-09-08T05:56:42.711Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434gitlab # [ 145.931554] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.712Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"868f6c0e2411ef133692be1b","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-868f6c0e2411ef133692be1b: start","job_status":"start","queue_duration_s":0.687664,"scheduling_latency_s":0.687678}1435gitlab # [ 145.932202] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.721Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"868f6c0e2411ef133692be1b","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-868f6c0e2411ef133692be1b: done: 0.009041 sec","job_status":"done","queue_duration_s":0.687664,"scheduling_latency_s":0.687678,"redis_calls":13,"redis_duration_s":0.001552,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000996,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005536,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009041,"completed_at":"2026-09-08T05:56:42.721Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436gitlab # [ 145.947959] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.722Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"953f382a980cd554739d2182","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-953f382a980cd554739d2182: start","job_status":"start","queue_duration_s":0.697838,"scheduling_latency_s":0.697851}1437gitlab # [ 145.995375] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.736Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"953f382a980cd554739d2182","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-953f382a980cd554739d2182: done: 0.014007 sec","job_status":"done","queue_duration_s":0.697838,"scheduling_latency_s":0.697851,"redis_calls":13,"redis_duration_s":0.002489,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000631,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001858,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008279,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014007,"completed_at":"2026-09-08T05:56:42.736Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438gitlab # [ 145.996430] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.737Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5824cc7c46ac5cf417a94729","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5824cc7c46ac5cf417a94729: start","job_status":"start","queue_duration_s":0.712885,"scheduling_latency_s":0.712899}1439gitlab # [ 146.036121] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.747Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5824cc7c46ac5cf417a94729","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5824cc7c46ac5cf417a94729: done: 0.009468 sec","job_status":"done","queue_duration_s":0.712885,"scheduling_latency_s":0.712899,"redis_calls":13,"redis_duration_s":0.001487,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000478,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001009,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006196,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009468,"completed_at":"2026-09-08T05:56:42.747Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1440gitlab # [ 146.037999] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.748Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"823043cdd3c88e0901d32f2f","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-823043cdd3c88e0901d32f2f: start","job_status":"start","queue_duration_s":0.723163,"scheduling_latency_s":0.723176}1441gitlab # [ 146.077088] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.757Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"823043cdd3c88e0901d32f2f","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-823043cdd3c88e0901d32f2f: done: 0.009158 sec","job_status":"done","queue_duration_s":0.723163,"scheduling_latency_s":0.723176,"redis_calls":13,"redis_duration_s":0.001519,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000475,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001044,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006155,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009158,"completed_at":"2026-09-08T05:56:42.757Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 146.119754] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.758Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"867336ccb1dc94319ac79f30","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-867336ccb1dc94319ac79f30: start","job_status":"start","queue_duration_s":0.733137,"scheduling_latency_s":0.733151}1443gitlab # [ 146.120660] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.767Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"867336ccb1dc94319ac79f30","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-867336ccb1dc94319ac79f30: done: 0.009823 sec","job_status":"done","queue_duration_s":0.733137,"scheduling_latency_s":0.733151,"redis_calls":13,"redis_duration_s":0.002218,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001241,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000977,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005749,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009823,"completed_at":"2026-09-08T05:56:42.767Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444gitlab # [ 146.128912] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.769Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b408560162cb4205b0a2707e","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b408560162cb4205b0a2707e: start","job_status":"start","queue_duration_s":0.744149,"scheduling_latency_s":0.744162}1445gitlab # [ 146.171114] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.778Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b408560162cb4205b0a2707e","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b408560162cb4205b0a2707e: done: 0.009345 sec","job_status":"done","queue_duration_s":0.744149,"scheduling_latency_s":0.744162,"redis_calls":13,"redis_duration_s":0.00169,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000564,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001126,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006017,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009345,"completed_at":"2026-09-08T05:56:42.778Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446gitlab # [ 146.174054] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.779Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"134abda6d29c7e9297bd09d8","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-134abda6d29c7e9297bd09d8: start","job_status":"start","queue_duration_s":0.754308,"scheduling_latency_s":0.75432}1447gitlab # [ 146.185499] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.788Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"134abda6d29c7e9297bd09d8","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-134abda6d29c7e9297bd09d8: done: 0.009355 sec","job_status":"done","queue_duration_s":0.754308,"scheduling_latency_s":0.75432,"redis_calls":13,"redis_duration_s":0.001535,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000472,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001063,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006176,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009355,"completed_at":"2026-09-08T05:56:42.788Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 146.244593] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.789Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b61a462b39f6a76f6ff53455","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b61a462b39f6a76f6ff53455: start","job_status":"start","queue_duration_s":0.764449,"scheduling_latency_s":0.764463}1449gitlab # [ 146.245199] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.799Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b61a462b39f6a76f6ff53455","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b61a462b39f6a76f6ff53455: done: 0.010407 sec","job_status":"done","queue_duration_s":0.764449,"scheduling_latency_s":0.764463,"redis_calls":13,"redis_duration_s":0.0025979999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000547,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002051,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006245,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010407,"completed_at":"2026-09-08T05:56:42.799Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1450gitlab # [ 146.288582] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.800Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c2420f9bdd8aa3fca880d18","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c2420f9bdd8aa3fca880d18: start","job_status":"start","queue_duration_s":0.77574,"scheduling_latency_s":0.775756}1451gitlab # [ 146.289498] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.813Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c2420f9bdd8aa3fca880d18","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c2420f9bdd8aa3fca880d18: done: 0.012511 sec","job_status":"done","queue_duration_s":0.77574,"scheduling_latency_s":0.775756,"redis_calls":13,"redis_duration_s":0.0018319999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000697,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001135,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00831,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012511,"completed_at":"2026-09-08T05:56:42.813Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1452gitlab # [ 146.332693] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.815Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f064b181b87052c3999c7a53","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f064b181b87052c3999c7a53: start","job_status":"start","queue_duration_s":0.790188,"scheduling_latency_s":0.790209}1453gitlab # [ 146.333509] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.825Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f064b181b87052c3999c7a53","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f064b181b87052c3999c7a53: done: 0.009932 sec","job_status":"done","queue_duration_s":0.790188,"scheduling_latency_s":0.790209,"redis_calls":13,"redis_duration_s":0.001575,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001029,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006115,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009932,"completed_at":"2026-09-08T05:56:42.825Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454gitlab # [ 146.376475] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.825Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c50d464dd8403dd96d43222b","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c50d464dd8403dd96d43222b: start","job_status":"start","queue_duration_s":0.800925,"scheduling_latency_s":0.800938}1455gitlab # [ 146.377099] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.835Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c50d464dd8403dd96d43222b","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c50d464dd8403dd96d43222b: done: 0.009587 sec","job_status":"done","queue_duration_s":0.800925,"scheduling_latency_s":0.800938,"redis_calls":13,"redis_duration_s":0.001791,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001285,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006076,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009587,"completed_at":"2026-09-08T05:56:42.835Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1456gitlab # [ 146.402036] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.836Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0893869fbd2546373a7d9441","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0893869fbd2546373a7d9441: start","job_status":"start","queue_duration_s":0.811347,"scheduling_latency_s":0.81136}1457gitlab # [ 146.413108] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.845Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0893869fbd2546373a7d9441","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0893869fbd2546373a7d9441: done: 0.00944 sec","job_status":"done","queue_duration_s":0.811347,"scheduling_latency_s":0.81136,"redis_calls":13,"redis_duration_s":0.001594,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001063,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006041,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00944,"completed_at":"2026-09-08T05:56:42.845Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1458gitlab # [ 146.455521] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.846Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ba4e8e488f0caefa60731e2","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ba4e8e488f0caefa60731e2: start","job_status":"start","queue_duration_s":0.821613,"scheduling_latency_s":0.821626}1459gitlab # [ 146.458093] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.856Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ba4e8e488f0caefa60731e2","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ba4e8e488f0caefa60731e2: done: 0.009567 sec","job_status":"done","queue_duration_s":0.821613,"scheduling_latency_s":0.821626,"redis_calls":13,"redis_duration_s":0.001627,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001093,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005867,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009567,"completed_at":"2026-09-08T05:56:42.856Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460gitlab # [ 146.511839] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.856Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c9c833e26dee40246dee9fd","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c9c833e26dee40246dee9fd: start","job_status":"start","queue_duration_s":0.832001,"scheduling_latency_s":0.832014}1461gitlab # [ 146.512636] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.866Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c9c833e26dee40246dee9fd","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c9c833e26dee40246dee9fd: done: 0.009243 sec","job_status":"done","queue_duration_s":0.832001,"scheduling_latency_s":0.832014,"redis_calls":13,"redis_duration_s":0.001883,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001383,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005937,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009243,"completed_at":"2026-09-08T05:56:42.866Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1462gitlab # [ 146.553470] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.867Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ccb4a0c9498e18924081e9f","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ccb4a0c9498e18924081e9f: start","job_status":"start","queue_duration_s":0.842082,"scheduling_latency_s":0.842095}1463gitlab # [ 146.554173] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.876Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ccb4a0c9498e18924081e9f","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ccb4a0c9498e18924081e9f: done: 0.009435 sec","job_status":"done","queue_duration_s":0.842082,"scheduling_latency_s":0.842095,"redis_calls":13,"redis_duration_s":0.001591,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001086,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006091,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009435,"completed_at":"2026-09-08T05:56:42.876Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1464gitlab # [ 146.582695] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.877Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"845491795e1602340439d7b0","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-845491795e1602340439d7b0: start","job_status":"start","queue_duration_s":0.852428,"scheduling_latency_s":0.852441}1465gitlab # [ 146.622066] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.887Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"845491795e1602340439d7b0","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-845491795e1602340439d7b0: done: 0.010004 sec","job_status":"done","queue_duration_s":0.852428,"scheduling_latency_s":0.852441,"redis_calls":13,"redis_duration_s":0.0015930000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001056,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005756,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010004,"completed_at":"2026-09-08T05:56:42.887Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1466gitlab # [ 146.627646] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.888Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb3f825b3d828b108e571af0","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb3f825b3d828b108e571af0: start","job_status":"start","queue_duration_s":0.863277,"scheduling_latency_s":0.86329}1467gitlab # [ 146.665893] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.897Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb3f825b3d828b108e571af0","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb3f825b3d828b108e571af0: done: 0.009456 sec","job_status":"done","queue_duration_s":0.863277,"scheduling_latency_s":0.86329,"redis_calls":13,"redis_duration_s":0.0015829999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001058,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006072,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009456,"completed_at":"2026-09-08T05:56:42.897Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1468gitlab # [ 146.708825] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.898Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e7b5c8818d78e292d0034672","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e7b5c8818d78e292d0034672: start","job_status":"start","queue_duration_s":0.873632,"scheduling_latency_s":0.873645}1469gitlab # [ 146.709630] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.907Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e7b5c8818d78e292d0034672","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e7b5c8818d78e292d0034672: done: 0.009287 sec","job_status":"done","queue_duration_s":0.873632,"scheduling_latency_s":0.873645,"redis_calls":13,"redis_duration_s":0.001591,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001064,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005915,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009287,"completed_at":"2026-09-08T05:56:42.907Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470gitlab # [ 146.717134] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.908Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"755d7f90a85a211db33f53a1","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-755d7f90a85a211db33f53a1: start","job_status":"start","queue_duration_s":0.883778,"scheduling_latency_s":0.88379}1471gitlab # [ 146.728431] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.989Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"755d7f90a85a211db33f53a1","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-755d7f90a85a211db33f53a1: done: 0.080925 sec","job_status":"done","queue_duration_s":0.883778,"scheduling_latency_s":0.88379,"redis_calls":13,"redis_duration_s":0.0015970000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001069,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006887,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.080925,"completed_at":"2026-09-08T05:56:42.989Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1472gitlab # [ 146.763500] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:42.991Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5337450ebf199266da1ee7f7","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5337450ebf199266da1ee7f7: start","job_status":"start","queue_duration_s":0.966181,"scheduling_latency_s":0.966195}1473gitlab # [ 146.810731] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:43.000Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5337450ebf199266da1ee7f7","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5337450ebf199266da1ee7f7: done: 0.009481 sec","job_status":"done","queue_duration_s":0.966181,"scheduling_latency_s":0.966195,"redis_calls":13,"redis_duration_s":0.001892,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000856,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001036,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006009,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009481,"completed_at":"2026-09-08T05:56:43.000Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1474gitlab # [ 146.811695] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:43.001Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ddf48694d69c8bafa7961b7","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ddf48694d69c8bafa7961b7: start","job_status":"start","queue_duration_s":0.976446,"scheduling_latency_s":0.97646}1475gitlab # [ 146.851052] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:43.010Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ddf48694d69c8bafa7961b7","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ddf48694d69c8bafa7961b7: done: 0.009488 sec","job_status":"done","queue_duration_s":0.976446,"scheduling_latency_s":0.97646,"redis_calls":13,"redis_duration_s":0.0016070000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001079,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006061,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009488,"completed_at":"2026-09-08T05:56:43.010Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1476gitlab # [ 146.889527] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:43.011Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64900ee1797b178e65926532","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64900ee1797b178e65926532: start","job_status":"start","queue_duration_s":0.986892,"scheduling_latency_s":0.986904}1477gitlab # [ 146.890150] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:43.024Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64900ee1797b178e65926532","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64900ee1797b178e65926532: done: 0.012467 sec","job_status":"done","queue_duration_s":0.986892,"scheduling_latency_s":0.986904,"redis_calls":13,"redis_duration_s":0.004598,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003422,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001176,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006411,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012467,"completed_at":"2026-09-08T05:56:43.024Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1478gitlab # [ 146.935123] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:43.025Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08d633eaba0021d217f8b15d","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08d633eaba0021d217f8b15d: start","job_status":"start","queue_duration_s":1.000176,"scheduling_latency_s":1.000189}1479gitlab # [ 146.935652] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:43.034Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08d633eaba0021d217f8b15d","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08d633eaba0021d217f8b15d: done: 0.009239 sec","job_status":"done","queue_duration_s":1.000176,"scheduling_latency_s":1.000189,"redis_calls":13,"redis_duration_s":0.0014420000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000461,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000981,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005848,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009239,"completed_at":"2026-09-08T05:56:43.034Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1480gitlab # [ 146.943416] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:43.035Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee16ad4df89fe6a9513362e0","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee16ad4df89fe6a9513362e0: start","job_status":"start","queue_duration_s":1.010894,"scheduling_latency_s":1.010907}1481gitlab # [ 146.982078] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:43.044Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee16ad4df89fe6a9513362e0","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee16ad4df89fe6a9513362e0: done: 0.00911 sec","job_status":"done","queue_duration_s":1.010894,"scheduling_latency_s":1.010907,"redis_calls":13,"redis_duration_s":0.001469,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000955,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005734,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00911,"completed_at":"2026-09-08T05:56:43.044Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1482gitlab # [ 147.020653] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:43.045Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b84287432c0cf63a55738b9","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b84287432c0cf63a55738b9: start","job_status":"start","queue_duration_s":1.020813,"scheduling_latency_s":1.020825}1483gitlab # [ 147.021490] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:43.054Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b84287432c0cf63a55738b9","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b84287432c0cf63a55738b9: done: 0.009097 sec","job_status":"done","queue_duration_s":1.020813,"scheduling_latency_s":1.020825,"redis_calls":13,"redis_duration_s":0.001514,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001006,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006115,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009097,"completed_at":"2026-09-08T05:56:43.054Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1484gitlab # [ 147.033485] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:43.055Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d5c5df8f9edf600157c0bf1","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d5c5df8f9edf600157c0bf1: start","job_status":"start","queue_duration_s":1.03073,"scheduling_latency_s":1.030743}1485gitlab # [ 147.044532] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:43.074Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d5c5df8f9edf600157c0bf1","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d5c5df8f9edf600157c0bf1: done: 0.018543 sec","job_status":"done","queue_duration_s":1.03073,"scheduling_latency_s":1.030743,"redis_calls":13,"redis_duration_s":0.010499000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002072,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.008427,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006593,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018543,"completed_at":"2026-09-08T05:56:43.074Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1486gitlab # [ 147.112873] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:43.075Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a0b7e139f8cbb323cf5d9f1","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a0b7e139f8cbb323cf5d9f1: start","job_status":"start","queue_duration_s":1.050116,"scheduling_latency_s":1.050129}1487gitlab # [ 147.113794] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:43.084Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a0b7e139f8cbb323cf5d9f1","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a0b7e139f8cbb323cf5d9f1: done: 0.009527 sec","job_status":"done","queue_duration_s":1.050116,"scheduling_latency_s":1.050129,"redis_calls":13,"redis_duration_s":0.001607,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000467,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00114,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005857,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009527,"completed_at":"2026-09-08T05:56:43.084Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1488gitlab # [ 147.157942] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:43.085Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4ca98f904a2a1b3620ea430","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4ca98f904a2a1b3620ea430: start","job_status":"start","queue_duration_s":1.060718,"scheduling_latency_s":1.060731}1489gitlab # [ 147.158685] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:43.094Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4ca98f904a2a1b3620ea430","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4ca98f904a2a1b3620ea430: done: 0.00899 sec","job_status":"done","queue_duration_s":1.060718,"scheduling_latency_s":1.060731,"redis_calls":13,"redis_duration_s":0.00171,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000462,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001248,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006056,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00899,"completed_at":"2026-09-08T05:56:43.094Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1490gitlab # [ 147.168782] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:43.095Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"61ce0fb554a36e527a5e379c","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-61ce0fb554a36e527a5e379c: start","job_status":"start","queue_duration_s":1.070475,"scheduling_latency_s":1.070488}1491gitlab # [ 147.207744] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:43.104Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"61ce0fb554a36e527a5e379c","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-61ce0fb554a36e527a5e379c: done: 0.008965 sec","job_status":"done","queue_duration_s":1.070475,"scheduling_latency_s":1.070488,"redis_calls":13,"redis_duration_s":0.0014320000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000464,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000968,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008965,"completed_at":"2026-09-08T05:56:43.104Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1492gitlab # [ 147.213889] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:43.105Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f715aaf79373131e35d13e8","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f715aaf79373131e35d13e8: start","job_status":"start","queue_duration_s":1.080241,"scheduling_latency_s":1.080254}1493gitlab # [ 147.225159] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:43.125Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f715aaf79373131e35d13e8","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f715aaf79373131e35d13e8: done: 0.019967 sec","job_status":"done","queue_duration_s":1.080241,"scheduling_latency_s":1.080254,"redis_calls":13,"redis_duration_s":0.011906,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005105,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006801,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00659,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019967,"completed_at":"2026-09-08T05:56:43.125Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1494gitlab # [ 147.264191] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:43.128Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4c6f456e62fd79106ad27b4","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4c6f456e62fd79106ad27b4: start","job_status":"start","queue_duration_s":1.103765,"scheduling_latency_s":1.10378}1495gitlab # [ 147.270066] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:43.145Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4c6f456e62fd79106ad27b4","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4c6f456e62fd79106ad27b4: done: 0.016688 sec","job_status":"done","queue_duration_s":1.103765,"scheduling_latency_s":1.10378,"redis_calls":13,"redis_duration_s":0.007663,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002386,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005277,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006128,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016688,"completed_at":"2026-09-08T05:56:43.145Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1496gitlab # [ 147.304885] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:43.148Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8bfa6fc384a84d74bb4170a8","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8bfa6fc384a84d74bb4170a8: start","job_status":"start","queue_duration_s":1.123791,"scheduling_latency_s":1.123805}1497gitlab # [ 147.315904] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:43.164Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8bfa6fc384a84d74bb4170a8","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8bfa6fc384a84d74bb4170a8: done: 0.016098 sec","job_status":"done","queue_duration_s":1.123791,"scheduling_latency_s":1.123805,"redis_calls":13,"redis_duration_s":0.007043000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001669,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005374,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006553,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016098,"completed_at":"2026-09-08T05:56:43.164Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1498gitlab # [ 147.368206] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:43.165Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8ea4e4b378b50659eb4c170","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8ea4e4b378b50659eb4c170: start","job_status":"start","queue_duration_s":1.140827,"scheduling_latency_s":1.14084}1499gitlab # [ 147.368954] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:43.175Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8ea4e4b378b50659eb4c170","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8ea4e4b378b50659eb4c170: done: 0.009495 sec","job_status":"done","queue_duration_s":1.140827,"scheduling_latency_s":1.14084,"redis_calls":13,"redis_duration_s":0.001621,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001084,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006149,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009495,"completed_at":"2026-09-08T05:56:43.175Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1500gitlab # [ 147.395787] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:43.176Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2aaf7c5b2ad24214707b02a4","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2aaf7c5b2ad24214707b02a4: start","job_status":"start","queue_duration_s":1.151187,"scheduling_latency_s":1.151201}1501gitlab # [ 147.406720] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:43.185Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2aaf7c5b2ad24214707b02a4","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2aaf7c5b2ad24214707b02a4: done: 0.009457 sec","job_status":"done","queue_duration_s":1.151187,"scheduling_latency_s":1.151201,"redis_calls":13,"redis_duration_s":0.001738,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001214,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005614,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009457,"completed_at":"2026-09-08T05:56:43.185Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1502gitlab # [ 147.447256] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:43.186Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a6b81b02f2c522b89fb160e","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a6b81b02f2c522b89fb160e: start","job_status":"start","queue_duration_s":1.161841,"scheduling_latency_s":1.161855}1503gitlab # [ 147.452663] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:43.196Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a6b81b02f2c522b89fb160e","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a6b81b02f2c522b89fb160e: done: 0.009327 sec","job_status":"done","queue_duration_s":1.161841,"scheduling_latency_s":1.161855,"redis_calls":13,"redis_duration_s":0.0015929999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000561,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001032,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006004,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009327,"completed_at":"2026-09-08T05:56:43.196Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1504gitlab # [ 147.487796] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:43.196Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04a94f6c7a6558a4b3afbd86","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04a94f6c7a6558a4b3afbd86: start","job_status":"start","queue_duration_s":1.171994,"scheduling_latency_s":1.172008}1505gitlab # [ 147.529611] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:43.206Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04a94f6c7a6558a4b3afbd86","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04a94f6c7a6558a4b3afbd86: done: 0.009394 sec","job_status":"done","queue_duration_s":1.171994,"scheduling_latency_s":1.172008,"redis_calls":13,"redis_duration_s":0.001534,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000495,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001039,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006127,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009394,"completed_at":"2026-09-08T05:56:43.206Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1506gitlab # [ 147.532908] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:43.207Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f10ee6d4c1caf1bda06d062d","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f10ee6d4c1caf1bda06d062d: start","job_status":"start","queue_duration_s":1.182221,"scheduling_latency_s":1.182234}1507gitlab # [ 147.570987] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:43.216Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f10ee6d4c1caf1bda06d062d","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f10ee6d4c1caf1bda06d062d: done: 0.009329 sec","job_status":"done","queue_duration_s":1.182221,"scheduling_latency_s":1.182234,"redis_calls":13,"redis_duration_s":0.001482,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000485,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000997,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009329,"completed_at":"2026-09-08T05:56:43.216Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1508gitlab # [ 147.578098] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:43.217Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"425e5c5ff1a5dc3bbf7171fd","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-425e5c5ff1a5dc3bbf7171fd: start","job_status":"start","queue_duration_s":1.19237,"scheduling_latency_s":1.192383}1509gitlab # [ 147.615867] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:43.226Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"425e5c5ff1a5dc3bbf7171fd","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-425e5c5ff1a5dc3bbf7171fd: done: 0.009111 sec","job_status":"done","queue_duration_s":1.19237,"scheduling_latency_s":1.192383,"redis_calls":13,"redis_duration_s":0.001492,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00049,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001002,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005604,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009111,"completed_at":"2026-09-08T05:56:43.226Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1510gitlab # [ 147.622664] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:43.227Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27c6f01f8c3f6906ff9bc9f4","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27c6f01f8c3f6906ff9bc9f4: start","job_status":"start","queue_duration_s":1.202638,"scheduling_latency_s":1.202651}1511gitlab # [ 147.664053] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:56:43.236Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27c6f01f8c3f6906ff9bc9f4","created_at":"2026-09-08T05:56:41.977Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-4496014b0a4b4ff5","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"f674dc36d68e8538066a43826364c733","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:56:42.024Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27c6f01f8c3f6906ff9bc9f4: done: 0.009271 sec","job_status":"done","queue_duration_s":1.202638,"scheduling_latency_s":1.202651,"redis_calls":13,"redis_duration_s":0.001536,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001009,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005922,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009271,"completed_at":"2026-09-08T05:56:43.236Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1512gitlab # [ 147.844792] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 3432287098 wd_nsec: 34322868381513gitlab # [ 159.361552] setup-gitlab-start[2218]: W, [2026-09-08T05:56:56.689153 #2218] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1514gitlab # [ 164.111879] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:01.438Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"71be1f937098cc6b30a6e6b2","created_at":"2026-09-08T05:57:01.386Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e6ddcc872b2881321169c2efc08fce98","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:01.435Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-71be1f937098cc6b30a6e6b2: start","job_status":"start","queue_duration_s":0.002812,"scheduling_latency_s":0.002848}1515gitlab # [ 164.182077] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:01.510Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1516gitlab # [ 164.201604] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:01.529Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"71be1f937098cc6b30a6e6b2","created_at":"2026-09-08T05:57:01.386Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e6ddcc872b2881321169c2efc08fce98","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:01.435Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-71be1f937098cc6b30a6e6b2: done: 0.090658 sec","job_status":"done","queue_duration_s":0.002812,"scheduling_latency_s":0.002848,"redis_calls":7,"redis_duration_s":0.037097,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.008994,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.028103,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013354,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.090658,"completed_at":"2026-09-08T05:57:01.529Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1517gitlab # [ 164.262896] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:01.590Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"7253f1f68c427ff44697d951","created_at":"2026-09-08T05:57:01.502Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"454264bbae6ac9732ac33c5a0714ec95","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:01.508Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-7253f1f68c427ff44697d951: start","job_status":"start","queue_duration_s":0.082435,"scheduling_latency_s":0.082485}1518gitlab # [ 164.362719] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:01.690Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"7253f1f68c427ff44697d951","created_at":"2026-09-08T05:57:01.502Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"454264bbae6ac9732ac33c5a0714ec95","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:01.508Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-7253f1f68c427ff44697d951: done: 0.099548 sec","job_status":"done","queue_duration_s":0.082435,"scheduling_latency_s":0.082485,"redis_calls":14,"redis_duration_s":0.015385000000000001,"redis_read_bytes":16,"redis_write_bytes":4030,"redis_queues_calls":2,"redis_queues_duration_s":0.00038,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.008932,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.006073,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.041,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030624,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.099548,"completed_at":"2026-09-08T05:57:01.690Z","load_balancing_strategy":"primary","db_duration_s":0.064918,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1519gitlab # [ 164.400458] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:01.695Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"6fc029dc4e2652de06fcb673","created_at":"2026-09-08T05:57:01.522Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"87a3b81ef14844669b2ca8bb106285d9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:01.527Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-6fc029dc4e2652de06fcb673: start","job_status":"start","queue_duration_s":0.167583,"scheduling_latency_s":0.16769}1520gitlab # [ 164.401118] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:01.720Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"6fc029dc4e2652de06fcb673","created_at":"2026-09-08T05:57:01.522Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"87a3b81ef14844669b2ca8bb106285d9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:01.527Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-6fc029dc4e2652de06fcb673: done: 0.025202 sec","job_status":"done","queue_duration_s":0.167583,"scheduling_latency_s":0.16769,"redis_calls":7,"redis_duration_s":0.003942,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003486,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000456,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01157,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025202,"completed_at":"2026-09-08T05:57:01.720Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1521gitlab # [ 164.444482] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:01.727Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"90e264c5845b8bc71c37bd48","created_at":"2026-09-08T05:57:01.592Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3914161becd26afee851e1b2de391428","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:01.608Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-90e264c5845b8bc71c37bd48: start","job_status":"start","queue_duration_s":0.118914,"scheduling_latency_s":0.118932}1522gitlab # [ 164.593156] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:01.920Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"90e264c5845b8bc71c37bd48","created_at":"2026-09-08T05:57:01.592Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3914161becd26afee851e1b2de391428","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:01.608Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-90e264c5845b8bc71c37bd48: done: 0.193222 sec","job_status":"done","queue_duration_s":0.118914,"scheduling_latency_s":0.118932,"redis_calls":10,"redis_duration_s":0.047653999999999995,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.043243,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004411,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.037,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.037,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020793,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.039490494,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.193222,"completed_at":"2026-09-08T05:57:01.920Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.036645,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1523gitlab # [ 164.595367] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:01.923Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"efad831414acd634c2f0e0c7","created_at":"2026-09-08T05:57:01.624Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"827fddcf75563c0ea8499488af99fb08","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:01.627Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-efad831414acd634c2f0e0c7: start","job_status":"start","queue_duration_s":0.295727,"scheduling_latency_s":0.295763}1524gitlab # [ 164.621182] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:01.933Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1525gitlab # [ 164.673538] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:01.937Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"efad831414acd634c2f0e0c7","created_at":"2026-09-08T05:57:01.624Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"827fddcf75563c0ea8499488af99fb08","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:01.627Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-efad831414acd634c2f0e0c7: done: 0.014537 sec","job_status":"done","queue_duration_s":0.295727,"scheduling_latency_s":0.295763,"redis_calls":7,"redis_duration_s":0.001715,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001169,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000546,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008489,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014537,"completed_at":"2026-09-08T05:57:01.937Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1526gitlab # [ 164.675081] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:01.938Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"cdf04cab584c3c5b1a2b9a61","created_at":"2026-09-08T05:57:01.642Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"86221c4b8ff87609998304fdf61f54f0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:01.644Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-cdf04cab584c3c5b1a2b9a61: start","job_status":"start","queue_duration_s":0.293729,"scheduling_latency_s":0.293743}1527gitlab # [ 164.685453] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:01.950Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"cdf04cab584c3c5b1a2b9a61","created_at":"2026-09-08T05:57:01.642Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"86221c4b8ff87609998304fdf61f54f0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:01.644Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-cdf04cab584c3c5b1a2b9a61: done: 0.011407 sec","job_status":"done","queue_duration_s":0.293729,"scheduling_latency_s":0.293743,"redis_calls":9,"redis_duration_s":0.001218,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000641,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000577,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006593,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000334121,"exclusive_lock_hold_duration_s":0.003235048,"duration_s":0.011407,"completed_at":"2026-09-08T05:57:01.950Z","load_balancing_strategy":"primary","db_duration_s":0.001597,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1528gitlab # [ 164.728746] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:01.950Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"dae6ca262943eb0d458e9d73","created_at":"2026-09-08T05:57:01.651Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"31bfce65ceb8711b9ad44a08bff55050","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:01.653Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-dae6ca262943eb0d458e9d73: start","job_status":"start","queue_duration_s":0.296962,"scheduling_latency_s":0.296975}1529gitlab # [ 164.733590] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:01.975Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"dae6ca262943eb0d458e9d73","created_at":"2026-09-08T05:57:01.651Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"31bfce65ceb8711b9ad44a08bff55050","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:01.653Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-dae6ca262943eb0d458e9d73: done: 0.024377 sec","job_status":"done","queue_duration_s":0.296962,"scheduling_latency_s":0.296975,"redis_calls":9,"redis_duration_s":0.0012980000000000001,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000648,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00065,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010611,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000429384,"exclusive_lock_hold_duration_s":0.008123379,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.024377,"completed_at":"2026-09-08T05:57:01.975Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011018,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1530gitlab # [ 164.774914] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:01.976Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"3a2b03d948324d74eedd8b9b","created_at":"2026-09-08T05:57:01.666Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"283fe2e2cbe71b730e76d80dc1f0064f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:01.671Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-3a2b03d948324d74eedd8b9b: start","job_status":"start","queue_duration_s":0.305004,"scheduling_latency_s":0.305017}1531gitlab # [ 164.822760] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.072Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"3a2b03d948324d74eedd8b9b","created_at":"2026-09-08T05:57:01.666Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"283fe2e2cbe71b730e76d80dc1f0064f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:01.671Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-3a2b03d948324d74eedd8b9b: done: 0.095823 sec","job_status":"done","queue_duration_s":0.305004,"scheduling_latency_s":0.305017,"redis_calls":9,"redis_duration_s":0.001777,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000897,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00088,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015061,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000304229,"exclusive_lock_hold_duration_s":0.085478741,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.095823,"completed_at":"2026-09-08T05:57:02.072Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.082134,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1532gitlab # [ 164.824306] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.073Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"900cb8315d89edfffa6c5226","created_at":"2026-09-08T05:57:01.656Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c397f5ad63ea4958","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"454264bbae6ac9732ac33c5a0714ec95","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:01.673Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-900cb8315d89edfffa6c5226: start","job_status":"start","queue_duration_s":0.399509,"scheduling_latency_s":0.399523}1533gitlab # [ 164.835158] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.081Z","message":"No existing merge request to be cleaned up."}1534gitlab # [ 164.836705] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.086Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"900cb8315d89edfffa6c5226","created_at":"2026-09-08T05:57:01.656Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c397f5ad63ea4958","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"454264bbae6ac9732ac33c5a0714ec95","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:01.673Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-900cb8315d89edfffa6c5226: done: 0.013094 sec","job_status":"done","queue_duration_s":0.399509,"scheduling_latency_s":0.399523,"redis_calls":10,"redis_duration_s":0.002112,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000766,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001346,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007989,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013094,"completed_at":"2026-09-08T05:57:02.086Z","load_balancing_strategy":"primary","db_duration_s":0.001311,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1535gitlab # [ 164.905096] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.087Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a40af11d7a2b9bfde238a912","created_at":"2026-09-08T05:57:01.656Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c397f5ad63ea4958","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"454264bbae6ac9732ac33c5a0714ec95","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:01.673Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a40af11d7a2b9bfde238a912: start","job_status":"start","queue_duration_s":0.413676,"scheduling_latency_s":0.41369}1536gitlab # [ 164.905791] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.094Z","message":"No existing merge request to be cleaned up."}1537gitlab # [ 164.906487] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.098Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a40af11d7a2b9bfde238a912","created_at":"2026-09-08T05:57:01.656Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c397f5ad63ea4958","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"454264bbae6ac9732ac33c5a0714ec95","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:01.673Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a40af11d7a2b9bfde238a912: done: 0.011433 sec","job_status":"done","queue_duration_s":0.413676,"scheduling_latency_s":0.41369,"redis_calls":10,"redis_duration_s":0.002016,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000838,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001178,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00716,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011433,"completed_at":"2026-09-08T05:57:02.098Z","load_balancing_strategy":"primary","db_duration_s":0.000982,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1538gitlab # [ 164.918116] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.100Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"267f19c9fe0791dae9a287c6","created_at":"2026-09-08T05:57:01.656Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c397f5ad63ea4958","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"454264bbae6ac9732ac33c5a0714ec95","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:01.673Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-267f19c9fe0791dae9a287c6: start","job_status":"start","queue_duration_s":0.426142,"scheduling_latency_s":0.426154}1539gitlab # [ 164.960745] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.106Z","message":"No existing merge request to be cleaned up."}1540gitlab # [ 164.961467] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.110Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"267f19c9fe0791dae9a287c6","created_at":"2026-09-08T05:57:01.656Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c397f5ad63ea4958","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"454264bbae6ac9732ac33c5a0714ec95","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:01.673Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-267f19c9fe0791dae9a287c6: done: 0.010925 sec","job_status":"done","queue_duration_s":0.426142,"scheduling_latency_s":0.426154,"redis_calls":10,"redis_duration_s":0.001531,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000594,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000937,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007045,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010925,"completed_at":"2026-09-08T05:57:02.110Z","load_balancing_strategy":"primary","db_duration_s":0.00099,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1541gitlab # [ 164.964751] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.111Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ec791dbdca8412f5960f35ee","created_at":"2026-09-08T05:57:01.656Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c397f5ad63ea4958","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"454264bbae6ac9732ac33c5a0714ec95","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:01.673Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ec791dbdca8412f5960f35ee: start","job_status":"start","queue_duration_s":0.437928,"scheduling_latency_s":0.437941}1542gitlab # [ 164.975545] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.117Z","message":"No existing merge request to be cleaned up."}1543gitlab # [ 164.977189] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.122Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ec791dbdca8412f5960f35ee","created_at":"2026-09-08T05:57:01.656Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c397f5ad63ea4958","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"454264bbae6ac9732ac33c5a0714ec95","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:01.673Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ec791dbdca8412f5960f35ee: done: 0.010812 sec","job_status":"done","queue_duration_s":0.437928,"scheduling_latency_s":0.437941,"redis_calls":10,"redis_duration_s":0.001444,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000705,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000739,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007042,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010812,"completed_at":"2026-09-08T05:57:02.122Z","load_balancing_strategy":"primary","db_duration_s":0.000881,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1544gitlab # [ 165.012259] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.123Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"9ce10861cb4938bc32f25f44","created_at":"2026-09-08T05:57:01.682Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7d670a9dea1729a32721133fb57cc47b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-08T05:57:01.684Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-9ce10861cb4938bc32f25f44: start","job_status":"start","queue_duration_s":0.438785,"scheduling_latency_s":0.438797}1545gitlab # [ 165.054620] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.127Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1546gitlab # [ 165.055436] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.131Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"9ce10861cb4938bc32f25f44","created_at":"2026-09-08T05:57:01.682Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7d670a9dea1729a32721133fb57cc47b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-08T05:57:01.684Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-9ce10861cb4938bc32f25f44: done: 0.007657 sec","job_status":"done","queue_duration_s":0.438785,"scheduling_latency_s":0.438797,"redis_calls":7,"redis_duration_s":0.000881,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000637,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000244,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004639,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.007657,"completed_at":"2026-09-08T05:57:02.131Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1547gitlab # [ 165.062405] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.131Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"8317bb54d0e9df53e3b13669","created_at":"2026-09-08T05:57:01.695Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c1a34f0951f6ea73ecc52778b1f5270f","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:01.697Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-8317bb54d0e9df53e3b13669: start","job_status":"start","queue_duration_s":0.434016,"scheduling_latency_s":0.434029}1548gitlab # [ 165.109769] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.152Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"8317bb54d0e9df53e3b13669","created_at":"2026-09-08T05:57:01.695Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c1a34f0951f6ea73ecc52778b1f5270f","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:01.697Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-8317bb54d0e9df53e3b13669: done: 0.020779 sec","job_status":"done","queue_duration_s":0.434016,"scheduling_latency_s":0.434029,"redis_calls":7,"redis_duration_s":0.001701,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001175,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000526,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015428,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020779,"completed_at":"2026-09-08T05:57:02.152Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00228,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1549gitlab # [ 165.113056] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.153Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"0c751a4991de7206baf1388a","created_at":"2026-09-08T05:57:01.712Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2bbc7a1309f6538711309edc723b8797","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-08T05:57:01.716Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-0c751a4991de7206baf1388a: start","job_status":"start","queue_duration_s":0.437143,"scheduling_latency_s":0.437158}1550gitlab # [ 165.124314] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.158Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1551gitlab # [ 165.127507] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.161Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"0c751a4991de7206baf1388a","created_at":"2026-09-08T05:57:01.712Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2bbc7a1309f6538711309edc723b8797","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-08T05:57:01.716Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-0c751a4991de7206baf1388a: done: 0.007824 sec","job_status":"done","queue_duration_s":0.437143,"scheduling_latency_s":0.437158,"redis_calls":7,"redis_duration_s":0.00088,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000635,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000245,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004766,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.007824,"completed_at":"2026-09-08T05:57:02.161Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1552gitlab # [ 165.173073] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.162Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"2b942641b99364970eaa223a","created_at":"2026-09-08T05:57:01.728Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"04b776896db35566727326b307a9af39","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:01.809Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-2b942641b99364970eaa223a: start","job_status":"start","queue_duration_s":0.352896,"scheduling_latency_s":0.352909}1553gitlab # [ 165.174821] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.166Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1554gitlab # [ 165.181338] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.169Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"2b942641b99364970eaa223a","created_at":"2026-09-08T05:57:01.728Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"04b776896db35566727326b307a9af39","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:01.809Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-2b942641b99364970eaa223a: done: 0.007539 sec","job_status":"done","queue_duration_s":0.352896,"scheduling_latency_s":0.352909,"redis_calls":7,"redis_duration_s":0.000936,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000696,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00024,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004547,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.007539,"completed_at":"2026-09-08T05:57:02.169Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1555gitlab # [ 165.241967] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.170Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"dd2474635bed7ab01a9fb55b","created_at":"2026-09-08T05:57:01.845Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7ed70e22b405be38968fc354432c5621","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:01.848Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-dd2474635bed7ab01a9fb55b: start","job_status":"start","queue_duration_s":0.321943,"scheduling_latency_s":0.321955}1556gitlab # [ 165.242595] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.175Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1557gitlab # [ 165.243149] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.178Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"dd2474635bed7ab01a9fb55b","created_at":"2026-09-08T05:57:01.845Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7ed70e22b405be38968fc354432c5621","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:01.848Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-dd2474635bed7ab01a9fb55b: done: 0.007541 sec","job_status":"done","queue_duration_s":0.321943,"scheduling_latency_s":0.321955,"redis_calls":7,"redis_duration_s":0.0009119999999999999,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000663,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000249,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.004596,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.007541,"completed_at":"2026-09-08T05:57:02.178Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1558gitlab # [ 165.267228] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.179Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"35a0c579e9497bd5be7da89e","created_at":"2026-09-08T05:57:01.883Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5defd1c644016d46eb6a0458ae9d8eb2","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:01.887Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-35a0c579e9497bd5be7da89e: start","job_status":"start","queue_duration_s":0.291963,"scheduling_latency_s":0.291975}1559gitlab # [ 165.307777] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.188Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"35a0c579e9497bd5be7da89e","created_at":"2026-09-08T05:57:01.883Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5defd1c644016d46eb6a0458ae9d8eb2","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:01.887Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-35a0c579e9497bd5be7da89e: done: 0.009193 sec","job_status":"done","queue_duration_s":0.291963,"scheduling_latency_s":0.291975,"redis_calls":7,"redis_duration_s":0.000877,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000633,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000244,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005614,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009193,"completed_at":"2026-09-08T05:57:02.188Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000749,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1560gitlab # [ 165.316593] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.189Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"34795684d72ae9bd7954c19a","created_at":"2026-09-08T05:57:01.908Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:01.912Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-34795684d72ae9bd7954c19a: start","job_status":"start","queue_duration_s":0.276737,"scheduling_latency_s":0.276751}1561gitlab # [ 165.328659] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.240Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"34795684d72ae9bd7954c19a","created_at":"2026-09-08T05:57:01.908Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:01.912Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-34795684d72ae9bd7954c19a: done: 0.051811 sec","job_status":"done","queue_duration_s":0.276737,"scheduling_latency_s":0.276751,"redis_calls":60,"redis_duration_s":0.008307,"redis_read_bytes":108,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.00058,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.00735,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000377,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042882,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.051811,"completed_at":"2026-09-08T05:57:02.240Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1562gitlab # [ 165.387059] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.241Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f4bdb1f1eb5a2f3113932bdf","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f4bdb1f1eb5a2f3113932bdf: start","job_status":"start","queue_duration_s":0.005704,"scheduling_latency_s":0.005721}1563gitlab # [ 165.387711] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.251Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f4bdb1f1eb5a2f3113932bdf","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f4bdb1f1eb5a2f3113932bdf: done: 0.009586 sec","job_status":"done","queue_duration_s":0.005704,"scheduling_latency_s":0.005721,"redis_calls":13,"redis_duration_s":0.001533,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001029,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005969,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009586,"completed_at":"2026-09-08T05:57:02.251Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1564gitlab # [ 165.440570] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.252Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5d98f51253111145b47bb64","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5d98f51253111145b47bb64: start","job_status":"start","queue_duration_s":0.016124,"scheduling_latency_s":0.016137}1565gitlab # [ 165.441325] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.261Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5d98f51253111145b47bb64","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5d98f51253111145b47bb64: done: 0.009145 sec","job_status":"done","queue_duration_s":0.016124,"scheduling_latency_s":0.016137,"redis_calls":13,"redis_duration_s":0.0015869999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001088,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005779,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009145,"completed_at":"2026-09-08T05:57:02.261Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1566gitlab # [ 165.455632] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.262Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8298bf5b5d3c7d61ce6eadb","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8298bf5b5d3c7d61ce6eadb: start","job_status":"start","queue_duration_s":0.026115,"scheduling_latency_s":0.026128}1567gitlab # [ 165.499339] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.271Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8298bf5b5d3c7d61ce6eadb","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8298bf5b5d3c7d61ce6eadb: done: 0.009036 sec","job_status":"done","queue_duration_s":0.026115,"scheduling_latency_s":0.026128,"redis_calls":13,"redis_duration_s":0.0015040000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001005,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005711,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009036,"completed_at":"2026-09-08T05:57:02.271Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1568gitlab # [ 165.500897] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.272Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94cbfb65e423414836e69cfa","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94cbfb65e423414836e69cfa: start","job_status":"start","queue_duration_s":0.035995,"scheduling_latency_s":0.036008}1569gitlab # [ 165.512197] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.281Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94cbfb65e423414836e69cfa","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94cbfb65e423414836e69cfa: done: 0.009049 sec","job_status":"done","queue_duration_s":0.035995,"scheduling_latency_s":0.036008,"redis_calls":13,"redis_duration_s":0.0015660000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000497,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001069,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005707,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009049,"completed_at":"2026-09-08T05:57:02.281Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1570gitlab # [ 165.575132] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.282Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31c09320b44902061b2f91fe","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31c09320b44902061b2f91fe: start","job_status":"start","queue_duration_s":0.045887,"scheduling_latency_s":0.045899}1571gitlab # [ 165.575855] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.291Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31c09320b44902061b2f91fe","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31c09320b44902061b2f91fe: done: 0.009153 sec","job_status":"done","queue_duration_s":0.045887,"scheduling_latency_s":0.045899,"redis_calls":13,"redis_duration_s":0.0016120000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00108,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005657,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009153,"completed_at":"2026-09-08T05:57:02.291Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1572gitlab # [ 165.592917] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.292Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"30f0f3c316ede562d287aaf6","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-30f0f3c316ede562d287aaf6: start","job_status":"start","queue_duration_s":0.055878,"scheduling_latency_s":0.05589}1573gitlab # [ 165.634237] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.301Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"30f0f3c316ede562d287aaf6","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-30f0f3c316ede562d287aaf6: done: 0.009095 sec","job_status":"done","queue_duration_s":0.055878,"scheduling_latency_s":0.05589,"redis_calls":13,"redis_duration_s":0.001572,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001043,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005756,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009095,"completed_at":"2026-09-08T05:57:02.301Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1574gitlab # [ 165.638886] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.302Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2165c502663e00ae329f917","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2165c502663e00ae329f917: start","job_status":"start","queue_duration_s":0.065868,"scheduling_latency_s":0.065882}1575gitlab # [ 165.683758] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.311Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2165c502663e00ae329f917","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2165c502663e00ae329f917: done: 0.009067 sec","job_status":"done","queue_duration_s":0.065868,"scheduling_latency_s":0.065882,"redis_calls":13,"redis_duration_s":0.001585,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001055,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005716,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009067,"completed_at":"2026-09-08T05:57:02.311Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1576gitlab # [ 165.684766] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.311Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08118b51230bfda9793997d9","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08118b51230bfda9793997d9: start","job_status":"start","queue_duration_s":0.07579,"scheduling_latency_s":0.075803}1577gitlab # [ 165.730300] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.321Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08118b51230bfda9793997d9","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08118b51230bfda9793997d9: done: 0.009296 sec","job_status":"done","queue_duration_s":0.07579,"scheduling_latency_s":0.075803,"redis_calls":13,"redis_duration_s":0.0015769999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000496,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001081,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005734,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009296,"completed_at":"2026-09-08T05:57:02.321Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1578gitlab # [ 165.731429] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.322Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6677d47116f96643feb1202","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6677d47116f96643feb1202: start","job_status":"start","queue_duration_s":0.085916,"scheduling_latency_s":0.085929}1579gitlab # [ 165.740658] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.332Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6677d47116f96643feb1202","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6677d47116f96643feb1202: done: 0.010826 sec","job_status":"done","queue_duration_s":0.085916,"scheduling_latency_s":0.085929,"redis_calls":13,"redis_duration_s":0.0030230000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001998,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001025,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006017,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010826,"completed_at":"2026-09-08T05:57:02.332Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1580gitlab # [ 165.775638] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.333Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5331087220ed0f03cdd441ac","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5331087220ed0f03cdd441ac: start","job_status":"start","queue_duration_s":0.097605,"scheduling_latency_s":0.097619}1581gitlab # [ 165.786846] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.342Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5331087220ed0f03cdd441ac","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5331087220ed0f03cdd441ac: done: 0.009073 sec","job_status":"done","queue_duration_s":0.097605,"scheduling_latency_s":0.097619,"redis_calls":13,"redis_duration_s":0.001599,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000567,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001032,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005711,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009073,"completed_at":"2026-09-08T05:57:02.342Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1582gitlab # [ 165.828440] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.343Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2dc99255428a255bd2ebef9","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2dc99255428a255bd2ebef9: start","job_status":"start","queue_duration_s":0.107505,"scheduling_latency_s":0.107518}1583gitlab # [ 165.831644] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.352Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c2dc99255428a255bd2ebef9","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c2dc99255428a255bd2ebef9: done: 0.008978 sec","job_status":"done","queue_duration_s":0.107505,"scheduling_latency_s":0.107518,"redis_calls":13,"redis_duration_s":0.0015569999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001032,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005691,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008978,"completed_at":"2026-09-08T05:57:02.352Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1584gitlab # [ 165.878327] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.353Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3dd8b0d7e927e52984e76179","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3dd8b0d7e927e52984e76179: start","job_status":"start","queue_duration_s":0.117288,"scheduling_latency_s":0.117301}1585gitlab # [ 165.879043] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.362Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3dd8b0d7e927e52984e76179","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3dd8b0d7e927e52984e76179: done: 0.009124 sec","job_status":"done","queue_duration_s":0.117288,"scheduling_latency_s":0.117301,"redis_calls":13,"redis_duration_s":0.001498,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000495,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001003,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005785,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009124,"completed_at":"2026-09-08T05:57:02.362Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1586gitlab # [ 165.923758] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.363Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c5a6cb23ac38f5b7ad26c78","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c5a6cb23ac38f5b7ad26c78: start","job_status":"start","queue_duration_s":0.127215,"scheduling_latency_s":0.127227}1587gitlab # [ 165.924667] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.372Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c5a6cb23ac38f5b7ad26c78","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c5a6cb23ac38f5b7ad26c78: done: 0.008995 sec","job_status":"done","queue_duration_s":0.127215,"scheduling_latency_s":0.127227,"redis_calls":13,"redis_duration_s":0.0015530000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000494,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001059,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005686,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008995,"completed_at":"2026-09-08T05:57:02.372Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1588gitlab # [ 165.956740] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.373Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5ce295b499037650a91b489","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5ce295b499037650a91b489: start","job_status":"start","queue_duration_s":0.137045,"scheduling_latency_s":0.137057}1589gitlab # [ 166.003868] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.382Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5ce295b499037650a91b489","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5ce295b499037650a91b489: done: 0.009042 sec","job_status":"done","queue_duration_s":0.137045,"scheduling_latency_s":0.137057,"redis_calls":13,"redis_duration_s":0.001561,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001061,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005703,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009042,"completed_at":"2026-09-08T05:57:02.382Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1590gitlab # [ 166.004953] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.383Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f4881ecb6706838bc326160","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f4881ecb6706838bc326160: start","job_status":"start","queue_duration_s":0.146916,"scheduling_latency_s":0.146929}1591gitlab # [ 166.012696] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.392Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f4881ecb6706838bc326160","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f4881ecb6706838bc326160: done: 0.009046 sec","job_status":"done","queue_duration_s":0.146916,"scheduling_latency_s":0.146929,"redis_calls":13,"redis_duration_s":0.001536,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001006,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005717,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009046,"completed_at":"2026-09-08T05:57:02.392Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1592gitlab # [ 166.084323] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.392Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"533377efca0106ffd154baed","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-533377efca0106ffd154baed: start","job_status":"start","queue_duration_s":0.156806,"scheduling_latency_s":0.156819}1593gitlab # [ 166.085033] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.404Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"533377efca0106ffd154baed","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-533377efca0106ffd154baed: done: 0.011805 sec","job_status":"done","queue_duration_s":0.156806,"scheduling_latency_s":0.156819,"redis_calls":13,"redis_duration_s":0.001881,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00057,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001311,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008018,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011805,"completed_at":"2026-09-08T05:57:02.404Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1594gitlab # [ 166.092957] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.405Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98d3447989d89e6424407fcf","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98d3447989d89e6424407fcf: start","job_status":"start","queue_duration_s":0.169683,"scheduling_latency_s":0.169702}1595gitlab # [ 166.104040] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.415Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98d3447989d89e6424407fcf","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98d3447989d89e6424407fcf: done: 0.009836 sec","job_status":"done","queue_duration_s":0.169683,"scheduling_latency_s":0.169702,"redis_calls":13,"redis_duration_s":0.001483,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000482,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006311,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009836,"completed_at":"2026-09-08T05:57:02.415Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1596gitlab # [ 166.155160] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.416Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb96bef353caf2d0ff18a4ae","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb96bef353caf2d0ff18a4ae: start","job_status":"start","queue_duration_s":0.180286,"scheduling_latency_s":0.180298}1597gitlab # [ 166.155798] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.426Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb96bef353caf2d0ff18a4ae","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb96bef353caf2d0ff18a4ae: done: 0.009575 sec","job_status":"done","queue_duration_s":0.180286,"scheduling_latency_s":0.180298,"redis_calls":13,"redis_duration_s":0.0019169999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000465,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001452,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006065,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009575,"completed_at":"2026-09-08T05:57:02.425Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1598gitlab # [ 166.201760] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.426Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0c0628a67ee995a4c626460","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0c0628a67ee995a4c626460: start","job_status":"start","queue_duration_s":0.19067,"scheduling_latency_s":0.190683}1599gitlab # [ 166.202635] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.435Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0c0628a67ee995a4c626460","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0c0628a67ee995a4c626460: done: 0.008895 sec","job_status":"done","queue_duration_s":0.19067,"scheduling_latency_s":0.190683,"redis_calls":13,"redis_duration_s":0.00151,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001005,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005915,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008895,"completed_at":"2026-09-08T05:57:02.435Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1600gitlab # [ 166.244691] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.436Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e62cfb7a27863f634661f4ef","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e62cfb7a27863f634661f4ef: start","job_status":"start","queue_duration_s":0.200376,"scheduling_latency_s":0.200389}1601gitlab # [ 166.245624] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.448Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e62cfb7a27863f634661f4ef","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e62cfb7a27863f634661f4ef: done: 0.011526 sec","job_status":"done","queue_duration_s":0.200376,"scheduling_latency_s":0.200389,"redis_calls":13,"redis_duration_s":0.00166,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001123,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005889,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011526,"completed_at":"2026-09-08T05:57:02.447Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1602gitlab # [ 166.274762] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.448Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8fcffafa2af8fbbf8e1e243f","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8fcffafa2af8fbbf8e1e243f: start","job_status":"start","queue_duration_s":0.212769,"scheduling_latency_s":0.212781}1603gitlab # [ 166.286046] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.457Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8fcffafa2af8fbbf8e1e243f","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8fcffafa2af8fbbf8e1e243f: done: 0.009025 sec","job_status":"done","queue_duration_s":0.212769,"scheduling_latency_s":0.212781,"redis_calls":13,"redis_duration_s":0.001538,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001028,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005657,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009025,"completed_at":"2026-09-08T05:57:02.457Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1604gitlab # [ 166.324738] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.458Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cea112b4fce58f41a32c344c","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cea112b4fce58f41a32c344c: start","job_status":"start","queue_duration_s":0.222656,"scheduling_latency_s":0.222669}1605gitlab # [ 166.330935] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.467Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cea112b4fce58f41a32c344c","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cea112b4fce58f41a32c344c: done: 0.009126 sec","job_status":"done","queue_duration_s":0.222656,"scheduling_latency_s":0.222669,"redis_calls":13,"redis_duration_s":0.001582,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001077,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005773,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009126,"completed_at":"2026-09-08T05:57:02.467Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1606gitlab # [ 166.369757] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.468Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"30a4e9eded6bc965ae733e00","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-30a4e9eded6bc965ae733e00: start","job_status":"start","queue_duration_s":0.232635,"scheduling_latency_s":0.232648}1607gitlab # [ 166.376085] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.477Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"30a4e9eded6bc965ae733e00","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-30a4e9eded6bc965ae733e00: done: 0.009167 sec","job_status":"done","queue_duration_s":0.232635,"scheduling_latency_s":0.232648,"redis_calls":13,"redis_duration_s":0.001577,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001072,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00577,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009167,"completed_at":"2026-09-08T05:57:02.477Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1608gitlab # [ 166.442802] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.478Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2a95ba5ed441f6d2cc39507a","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2a95ba5ed441f6d2cc39507a: start","job_status":"start","queue_duration_s":0.242645,"scheduling_latency_s":0.242658}1609gitlab # [ 166.443681] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.490Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2a95ba5ed441f6d2cc39507a","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2a95ba5ed441f6d2cc39507a: done: 0.011887 sec","job_status":"done","queue_duration_s":0.242645,"scheduling_latency_s":0.242658,"redis_calls":13,"redis_duration_s":0.0017929999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0006,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001193,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008203,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011887,"completed_at":"2026-09-08T05:57:02.490Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1610gitlab # [ 166.483619] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.491Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c0bee3be64d7b7d0bf03679","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c0bee3be64d7b7d0bf03679: start","job_status":"start","queue_duration_s":0.255725,"scheduling_latency_s":0.255747}1611gitlab # [ 166.484236] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.516Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c0bee3be64d7b7d0bf03679","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c0bee3be64d7b7d0bf03679: done: 0.024384 sec","job_status":"done","queue_duration_s":0.255725,"scheduling_latency_s":0.255747,"redis_calls":13,"redis_duration_s":0.00946,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003397,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006063,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006988,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024384,"completed_at":"2026-09-08T05:57:02.516Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1612gitlab # [ 166.525950] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.517Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a00d4e06e680668e9d5e9c23","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a00d4e06e680668e9d5e9c23: start","job_status":"start","queue_duration_s":0.281043,"scheduling_latency_s":0.281058}1613gitlab # [ 166.526687] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.529Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a00d4e06e680668e9d5e9c23","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a00d4e06e680668e9d5e9c23: done: 0.012142 sec","job_status":"done","queue_duration_s":0.281043,"scheduling_latency_s":0.281058,"redis_calls":13,"redis_duration_s":0.00163,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001099,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006082,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012142,"completed_at":"2026-09-08T05:57:02.529Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1614gitlab # [ 166.547308] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.530Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"481e60018cb96be1463b3f19","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-481e60018cb96be1463b3f19: start","job_status":"start","queue_duration_s":0.294037,"scheduling_latency_s":0.29405}1615gitlab # [ 166.558772] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.539Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"481e60018cb96be1463b3f19","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-481e60018cb96be1463b3f19: done: 0.009031 sec","job_status":"done","queue_duration_s":0.294037,"scheduling_latency_s":0.29405,"redis_calls":13,"redis_duration_s":0.0015270000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000497,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00103,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005682,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009031,"completed_at":"2026-09-08T05:57:02.539Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1616gitlab # [ 166.594037] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.540Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"791aafd5dc861ae7bbadd17a","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-791aafd5dc861ae7bbadd17a: start","job_status":"start","queue_duration_s":0.3039,"scheduling_latency_s":0.303913}1617gitlab # [ 166.605622] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.549Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"791aafd5dc861ae7bbadd17a","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-791aafd5dc861ae7bbadd17a: done: 0.009056 sec","job_status":"done","queue_duration_s":0.3039,"scheduling_latency_s":0.303913,"redis_calls":13,"redis_duration_s":0.001539,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001013,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005709,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009056,"completed_at":"2026-09-08T05:57:02.549Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1618gitlab # [ 166.647522] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.549Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04332f0404da1cbfb48e28b1","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04332f0404da1cbfb48e28b1: start","job_status":"start","queue_duration_s":0.313799,"scheduling_latency_s":0.313812}1619gitlab # [ 166.650728] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.559Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04332f0404da1cbfb48e28b1","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04332f0404da1cbfb48e28b1: done: 0.009246 sec","job_status":"done","queue_duration_s":0.313799,"scheduling_latency_s":0.313812,"redis_calls":13,"redis_duration_s":0.001677,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001145,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005815,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009246,"completed_at":"2026-09-08T05:57:02.559Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1620gitlab # [ 166.686178] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.560Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fbb53402387150259ca971b1","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fbb53402387150259ca971b1: start","job_status":"start","queue_duration_s":0.323883,"scheduling_latency_s":0.323896}1621gitlab # [ 166.727990] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.569Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fbb53402387150259ca971b1","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fbb53402387150259ca971b1: done: 0.00902 sec","job_status":"done","queue_duration_s":0.323883,"scheduling_latency_s":0.323896,"redis_calls":13,"redis_duration_s":0.001608,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001074,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005683,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00902,"completed_at":"2026-09-08T05:57:02.569Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1622gitlab # [ 166.731550] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.569Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e29fa459da4a75894dd1149","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e29fa459da4a75894dd1149: start","job_status":"start","queue_duration_s":0.333744,"scheduling_latency_s":0.333758}1623gitlab # [ 166.773529] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.578Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e29fa459da4a75894dd1149","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e29fa459da4a75894dd1149: done: 0.009036 sec","job_status":"done","queue_duration_s":0.333744,"scheduling_latency_s":0.333758,"redis_calls":13,"redis_duration_s":0.001557,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001057,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005739,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009036,"completed_at":"2026-09-08T05:57:02.578Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1624gitlab # [ 166.776771] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.579Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff8e51055db218d1e2966427","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff8e51055db218d1e2966427: start","job_status":"start","queue_duration_s":0.343641,"scheduling_latency_s":0.343655}1625gitlab # [ 166.788037] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.588Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff8e51055db218d1e2966427","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff8e51055db218d1e2966427: done: 0.009 sec","job_status":"done","queue_duration_s":0.343641,"scheduling_latency_s":0.343655,"redis_calls":13,"redis_duration_s":0.001584,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000557,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001027,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005688,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009,"completed_at":"2026-09-08T05:57:02.588Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1626gitlab # [ 166.830620] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.589Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1779c0040ce0ed9efed9dd80","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1779c0040ce0ed9efed9dd80: start","job_status":"start","queue_duration_s":0.353476,"scheduling_latency_s":0.353489}1627gitlab # [ 166.832985] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.598Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1779c0040ce0ed9efed9dd80","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1779c0040ce0ed9efed9dd80: done: 0.00896 sec","job_status":"done","queue_duration_s":0.353476,"scheduling_latency_s":0.353489,"redis_calls":13,"redis_duration_s":0.00152,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000494,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001026,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00567,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00896,"completed_at":"2026-09-08T05:57:02.598Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1628gitlab # [ 166.889082] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.599Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80cf15908aa82d222825e38d","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80cf15908aa82d222825e38d: start","job_status":"start","queue_duration_s":0.363244,"scheduling_latency_s":0.363256}1629gitlab # [ 166.889831] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.608Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80cf15908aa82d222825e38d","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80cf15908aa82d222825e38d: done: 0.009033 sec","job_status":"done","queue_duration_s":0.363244,"scheduling_latency_s":0.363256,"redis_calls":13,"redis_duration_s":0.00154,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000495,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001045,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005651,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009033,"completed_at":"2026-09-08T05:57:02.608Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1630gitlab # [ 166.913694] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.609Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"24d1666b0d4798beb4923689","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-24d1666b0d4798beb4923689: start","job_status":"start","queue_duration_s":0.373121,"scheduling_latency_s":0.373136}1631gitlab # [ 166.924839] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.618Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"24d1666b0d4798beb4923689","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-24d1666b0d4798beb4923689: done: 0.009121 sec","job_status":"done","queue_duration_s":0.373121,"scheduling_latency_s":0.373136,"redis_calls":13,"redis_duration_s":0.0015819999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000498,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001084,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005695,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009121,"completed_at":"2026-09-08T05:57:02.618Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1632gitlab # [ 166.967742] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.619Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd2ff4f7ed927cc8d941941b","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd2ff4f7ed927cc8d941941b: start","job_status":"start","queue_duration_s":0.383081,"scheduling_latency_s":0.383093}1633gitlab # [ 166.970255] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.631Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd2ff4f7ed927cc8d941941b","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd2ff4f7ed927cc8d941941b: done: 0.011874 sec","job_status":"done","queue_duration_s":0.383081,"scheduling_latency_s":0.383093,"redis_calls":13,"redis_duration_s":0.002012,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000804,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001208,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007892,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011874,"completed_at":"2026-09-08T05:57:02.631Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1634gitlab # [ 167.005618] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.632Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad3065e9bc86809ac448b71b","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad3065e9bc86809ac448b71b: start","job_status":"start","queue_duration_s":0.396006,"scheduling_latency_s":0.396026}1635gitlab # [ 167.050119] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.642Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad3065e9bc86809ac448b71b","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad3065e9bc86809ac448b71b: done: 0.010192 sec","job_status":"done","queue_duration_s":0.396006,"scheduling_latency_s":0.396026,"redis_calls":13,"redis_duration_s":0.001621,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000581,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00636,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010192,"completed_at":"2026-09-08T05:57:02.642Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1636gitlab # [ 167.051112] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.643Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f97e3d5a0025f4b401d9551","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f97e3d5a0025f4b401d9551: start","job_status":"start","queue_duration_s":0.407074,"scheduling_latency_s":0.407089}1637gitlab # [ 167.062043] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.688Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f97e3d5a0025f4b401d9551","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f97e3d5a0025f4b401d9551: done: 0.045537 sec","job_status":"done","queue_duration_s":0.407074,"scheduling_latency_s":0.407089,"redis_calls":13,"redis_duration_s":0.00174,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00058,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00116,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040769,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.045537,"completed_at":"2026-09-08T05:57:02.688Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1638gitlab # [ 167.131244] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.690Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3438fb378f1c2861a8d02a9","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3438fb378f1c2861a8d02a9: start","job_status":"start","queue_duration_s":0.453846,"scheduling_latency_s":0.453876}1639gitlab # [ 167.131686] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.701Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3438fb378f1c2861a8d02a9","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3438fb378f1c2861a8d02a9: done: 0.011898 sec","job_status":"done","queue_duration_s":0.453846,"scheduling_latency_s":0.453876,"redis_calls":13,"redis_duration_s":0.0015209999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000489,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001032,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007315,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011898,"completed_at":"2026-09-08T05:57:02.701Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1640gitlab # [ 167.142838] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.702Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"206df6c3cf6633ac48bad251","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-206df6c3cf6633ac48bad251: start","job_status":"start","queue_duration_s":0.466531,"scheduling_latency_s":0.466543}1641gitlab # [ 167.154035] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.711Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"206df6c3cf6633ac48bad251","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-206df6c3cf6633ac48bad251: done: 0.008594 sec","job_status":"done","queue_duration_s":0.466531,"scheduling_latency_s":0.466543,"redis_calls":13,"redis_duration_s":0.00145,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000462,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000988,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005665,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008594,"completed_at":"2026-09-08T05:57:02.711Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1642gitlab # [ 167.212939] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.712Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"827ed3b0d4feb692f757b39d","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-827ed3b0d4feb692f757b39d: start","job_status":"start","queue_duration_s":0.476462,"scheduling_latency_s":0.476475}1643gitlab # [ 167.213591] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.723Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"827ed3b0d4feb692f757b39d","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-827ed3b0d4feb692f757b39d: done: 0.011132 sec","job_status":"done","queue_duration_s":0.476462,"scheduling_latency_s":0.476475,"redis_calls":13,"redis_duration_s":0.0021219999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001023,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001099,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007269,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011132,"completed_at":"2026-09-08T05:57:02.723Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1644gitlab # [ 167.257964] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.724Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"308bbcf01e5d8e4e46004e57","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-308bbcf01e5d8e4e46004e57: start","job_status":"start","queue_duration_s":0.488559,"scheduling_latency_s":0.488578}1645gitlab # [ 167.258686] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.734Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"308bbcf01e5d8e4e46004e57","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-308bbcf01e5d8e4e46004e57: done: 0.009716 sec","job_status":"done","queue_duration_s":0.488559,"scheduling_latency_s":0.488578,"redis_calls":13,"redis_duration_s":0.001598,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001069,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006086,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009716,"completed_at":"2026-09-08T05:57:02.734Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1646gitlab # [ 167.303884] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.735Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b51568db1b9ab44b0fec6ce","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b51568db1b9ab44b0fec6ce: start","job_status":"start","queue_duration_s":0.499074,"scheduling_latency_s":0.499087}1647gitlab # [ 167.304644] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.744Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b51568db1b9ab44b0fec6ce","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b51568db1b9ab44b0fec6ce: done: 0.009222 sec","job_status":"done","queue_duration_s":0.499074,"scheduling_latency_s":0.499087,"redis_calls":13,"redis_duration_s":0.001495,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000487,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001008,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005929,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009222,"completed_at":"2026-09-08T05:57:02.744Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1648gitlab # [ 167.360296] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.745Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d4c8044fd3387d8b967e0eec","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d4c8044fd3387d8b967e0eec: start","job_status":"start","queue_duration_s":0.509145,"scheduling_latency_s":0.509159}1649gitlab # [ 167.360989] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.756Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d4c8044fd3387d8b967e0eec","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d4c8044fd3387d8b967e0eec: done: 0.011129 sec","job_status":"done","queue_duration_s":0.509145,"scheduling_latency_s":0.509159,"redis_calls":13,"redis_duration_s":0.001656,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001151,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006945,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011129,"completed_at":"2026-09-08T05:57:02.756Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1650gitlab # [ 167.369589] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.757Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07c148973adf6db49f2dcfc1","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07c148973adf6db49f2dcfc1: start","job_status":"start","queue_duration_s":0.521235,"scheduling_latency_s":0.521251}1651gitlab # [ 167.411330] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.766Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07c148973adf6db49f2dcfc1","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07c148973adf6db49f2dcfc1: done: 0.009459 sec","job_status":"done","queue_duration_s":0.521235,"scheduling_latency_s":0.521251,"redis_calls":13,"redis_duration_s":0.0014520000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000497,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000955,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006281,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009459,"completed_at":"2026-09-08T05:57:02.766Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1652gitlab # [ 167.450997] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.767Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cbbd76179d32157d4d3baac0","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cbbd76179d32157d4d3baac0: start","job_status":"start","queue_duration_s":0.531493,"scheduling_latency_s":0.531505}1653gitlab # [ 167.451718] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.776Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cbbd76179d32157d4d3baac0","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cbbd76179d32157d4d3baac0: done: 0.009306 sec","job_status":"done","queue_duration_s":0.531493,"scheduling_latency_s":0.531505,"redis_calls":13,"redis_duration_s":0.00159,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001061,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005977,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009306,"completed_at":"2026-09-08T05:57:02.776Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1654gitlab # [ 167.459892] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.777Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3eb81391e16da924c515728","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3eb81391e16da924c515728: start","job_status":"start","queue_duration_s":0.541649,"scheduling_latency_s":0.541662}1655gitlab # [ 167.471154] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.786Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3eb81391e16da924c515728","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3eb81391e16da924c515728: done: 0.008961 sec","job_status":"done","queue_duration_s":0.541649,"scheduling_latency_s":0.541662,"redis_calls":13,"redis_duration_s":0.00156,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001052,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005417,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008961,"completed_at":"2026-09-08T05:57:02.786Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1656gitlab # [ 167.512678] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.787Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a46e53d7cf986173c1516919","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a46e53d7cf986173c1516919: start","job_status":"start","queue_duration_s":0.551757,"scheduling_latency_s":0.551769}1657gitlab # [ 167.516117] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.797Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a46e53d7cf986173c1516919","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a46e53d7cf986173c1516919: done: 0.009104 sec","job_status":"done","queue_duration_s":0.551757,"scheduling_latency_s":0.551769,"redis_calls":13,"redis_duration_s":0.001509,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000964,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005888,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009104,"completed_at":"2026-09-08T05:57:02.796Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1658gitlab # [ 167.557277] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.797Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6391fd551fabf6843efaf5a9","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6391fd551fabf6843efaf5a9: start","job_status":"start","queue_duration_s":0.561713,"scheduling_latency_s":0.561726}1659gitlab # [ 167.561150] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.807Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6391fd551fabf6843efaf5a9","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6391fd551fabf6843efaf5a9: done: 0.009146 sec","job_status":"done","queue_duration_s":0.561713,"scheduling_latency_s":0.561726,"redis_calls":13,"redis_duration_s":0.0015370000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001015,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005931,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009146,"completed_at":"2026-09-08T05:57:02.806Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1660gitlab # [ 167.602513] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.807Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a0af5d3f4a29771073936d03","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a0af5d3f4a29771073936d03: start","job_status":"start","queue_duration_s":0.571674,"scheduling_latency_s":0.571687}1661gitlab # [ 167.606453] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:02.816Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a0af5d3f4a29771073936d03","created_at":"2026-09-08T05:57:02.194Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-251e410f364f403e","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"cecf3ddcd8438a1c4731a95039e7479c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:02.236Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a0af5d3f4a29771073936d03: done: 0.009008 sec","job_status":"done","queue_duration_s":0.571674,"scheduling_latency_s":0.571687,"redis_calls":13,"redis_duration_s":0.001472,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000957,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005813,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009008,"completed_at":"2026-09-08T05:57:02.816Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1662gitlab # [ 167.688838] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:05.016Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"20f9ca92649f0d8d1da19bdd","created_at":"2026-09-08T05:57:05.012Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"12e56a67ee1bcb20a5cd91f4e767672d","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:05.014Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-20f9ca92649f0d8d1da19bdd: start","job_status":"start","queue_duration_s":0.001448,"scheduling_latency_s":0.001473}1663gitlab # [ 167.750713] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:05.078Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"20f9ca92649f0d8d1da19bdd","created_at":"2026-09-08T05:57:05.012Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"12e56a67ee1bcb20a5cd91f4e767672d","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:05.014Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-20f9ca92649f0d8d1da19bdd: done: 0.062431 sec","job_status":"done","queue_duration_s":0.001448,"scheduling_latency_s":0.001473,"redis_calls":7,"redis_duration_s":0.014353000000000001,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.013166,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001187,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007718,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.062431,"completed_at":"2026-09-08T05:57:05.078Z","load_balancing_strategy":"primary","db_duration_s":0.012042,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1664gitlab # [ 167.800516] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:05.128Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"cc3fdbb3192b1ee3ea426f89","created_at":"2026-09-08T05:57:05.034Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d972f650694419f7d958ec805b768b5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-08T05:57:05.037Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-cc3fdbb3192b1ee3ea426f89: start","job_status":"start","queue_duration_s":0.090422,"scheduling_latency_s":0.090466}1665gitlab # [ 167.857499] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:05.185Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"cc3fdbb3192b1ee3ea426f89","created_at":"2026-09-08T05:57:05.034Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d972f650694419f7d958ec805b768b5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-08T05:57:05.037Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-cc3fdbb3192b1ee3ea426f89: done: 0.056997 sec","job_status":"done","queue_duration_s":0.090422,"scheduling_latency_s":0.090466,"redis_calls":7,"redis_duration_s":0.0036780000000000003,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002609,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001069,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023826,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.056997,"completed_at":"2026-09-08T05:57:05.185Z","load_balancing_strategy":"primary","db_duration_s":0.011436,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1666gitlab # [ 167.904532] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:05.232Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"8d760aa05041e6e061665dd8","created_at":"2026-09-08T05:57:05.052Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8b7917c3d8380e85a771094c86d58f89","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:05.055Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-8d760aa05041e6e061665dd8: start","job_status":"start","queue_duration_s":0.176979,"scheduling_latency_s":0.177026}1667gitlab # [ 167.936798] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:05.264Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"8d760aa05041e6e061665dd8","created_at":"2026-09-08T05:57:05.052Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8b7917c3d8380e85a771094c86d58f89","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:05.055Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-8d760aa05041e6e061665dd8: done: 0.032339 sec","job_status":"done","queue_duration_s":0.176979,"scheduling_latency_s":0.177026,"redis_calls":7,"redis_duration_s":0.001729,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001213,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000516,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013625,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032339,"completed_at":"2026-09-08T05:57:05.264Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1668gitlab # [ 167.974287] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:05.302Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"86559f9feecd404fe7a7abbc","created_at":"2026-09-08T05:57:05.062Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3e9105e04b7e4a20166c95e378a3ef87","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:05.063Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-86559f9feecd404fe7a7abbc: start","job_status":"start","queue_duration_s":0.238809,"scheduling_latency_s":0.238848}1669gitlab # [ 168.010533] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:05.338Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"86559f9feecd404fe7a7abbc","created_at":"2026-09-08T05:57:05.062Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3e9105e04b7e4a20166c95e378a3ef87","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:05.063Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-86559f9feecd404fe7a7abbc: done: 0.036155 sec","job_status":"done","queue_duration_s":0.238809,"scheduling_latency_s":0.238848,"redis_calls":9,"redis_duration_s":0.0022500000000000003,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001255,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000995,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016069,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000678299,"exclusive_lock_hold_duration_s":0.004377093,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.036155,"completed_at":"2026-09-08T05:57:05.338Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001791,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1670gitlab # [ 168.049982] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:05.377Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"9acb225e13c76e0d23df11d5","created_at":"2026-09-08T05:57:05.074Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b1d594095fcff918ccaece0a9d6079e9","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:05.077Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-9acb225e13c76e0d23df11d5: start","job_status":"start","queue_duration_s":0.300632,"scheduling_latency_s":0.300673}1671gitlab # [ 168.332313] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:05.659Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"9acb225e13c76e0d23df11d5","created_at":"2026-09-08T05:57:05.074Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b1d594095fcff918ccaece0a9d6079e9","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:05.077Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-9acb225e13c76e0d23df11d5: done: 0.281489 sec","job_status":"done","queue_duration_s":0.300632,"scheduling_latency_s":0.300673,"redis_calls":562,"redis_duration_s":0.083339,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00126,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.082079,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.224459,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.281489,"completed_at":"2026-09-08T05:57:05.659Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1672gitlab # [ 168.333657] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:05.660Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"24ab2462212a074b7254aa52","created_at":"2026-09-08T05:57:05.129Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"18e31e2716fea720f213b6dcc7915e28","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:05.142Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-24ab2462212a074b7254aa52: start","job_status":"start","queue_duration_s":0.518058,"scheduling_latency_s":0.518077}1673gitlab # [ 168.471799] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:05.799Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"24ab2462212a074b7254aa52","created_at":"2026-09-08T05:57:05.129Z","trace_propagation_headers":{"sentry-trace":"5b174fd05ab44aa4b698a7d8b99a07c0-c406d6414be04617","baggage":"sentry-trace_id=5b174fd05ab44aa4b698a7d8b99a07c0,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"18e31e2716fea720f213b6dcc7915e28","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:05.142Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-24ab2462212a074b7254aa52: done: 0.138957 sec","job_status":"done","queue_duration_s":0.518058,"scheduling_latency_s":0.518077,"redis_calls":9,"redis_duration_s":0.0020359999999999996,"redis_read_bytes":7,"redis_write_bytes":987,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000986,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00105,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.029,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.096633,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000403683,"exclusive_lock_hold_duration_s":0.127980232,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.138957,"completed_at":"2026-09-08T05:57:05.799Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.046165,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1674gitlab # [ 181.490518] postgres[2417]: [2417] ERROR: relation "table_without_models" does not exist1675gitlab # [ 181.491506] postgres[2417]: [2417] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1676gitlab # [ 185.057621] runuser[2217]: pam_unix(runuser:session): session closed for user gitlab1677gitlab # [ 185.058547] setup-gitlab-start[2199]: + systemctl restart gitlab-sidekiq.service1678gitlab # [ 185.071870] systemd[1]: Stopping gitlab-sidekiq.service...1679gitlab # [ 185.076530] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:22.404Z","message":"Shutting down"}1680gitlab # [ 185.076789] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:22.404Z","message":"Scheduler exiting..."}1681gitlab # [ 185.077469] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:22.405Z","message":"Terminating quiet threads for default capsule"}1682gitlab # [ 185.077971] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:22.405Z","message":"Scheduler exiting..."}1683gitlab # [ 185.578871] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:22.906Z","message":"Pausing to allow jobs to finish..."}1684gitlab # [ 189.084686] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:26.412Z","message":"Bye!"}1685gitlab # [ 189.113323] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-08T05:57:26.441Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1613,"worker_id":"sidekiq_0","memwd_rss_bytes":944644096,"retry":0}1686gitlab # [ 189.376936] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1687gitlab # [ 189.379772] systemd[1]: Stopped gitlab-sidekiq.service.1688gitlab # [ 189.381436] systemd[1]: gitlab-sidekiq.service: Consumed 57.285s CPU time over 1min 57.047s wall clock time, 959.1M memory peak, 4.4M read from disk.1689gitlab # [ 189.390744] systemd[1]: Started gitlab-sidekiq.service.1690gitlab # [ 189.397114] setup-gitlab-start[2199]: + mkdir -p /var/lib/secrets1691gitlab # [ 189.402124] setup-gitlab-start[2199]: + echo nixbot-test-token-of-20-chars1692gitlab # [ 189.402820] setup-gitlab-start[2199]: + chmod 644 /var/lib/secrets/gitlab-token1693gitlab # [ 189.406157] setup-gitlab-start[2199]: + timeout 300 bash -c $'until curl -fs -H "PRIVATE-TOKEN: $0" http://gitlab/api/v4/projects/root%2Ftest-flake > /dev/null; do\n curl -s -X POST -H "PRIVATE-TOKEN: $0" -H "Content-Type: application/json" \\\n -d "{\\"name\\":\\"test-flake\\",\\"visibility\\":\\"public\\",\\"topics\\":[\\"build-with-buildbot\\"]}" \\\n http://gitlab/api/v4/projects | jq -c "{id, message, error}"\n sleep 5\ndone' nixbot-test-token-of-20-chars1694gitlab # [ 189.605231] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:57:26 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 404 35 "" "curl/8.21.0" 1711695gitlab # [ 190.429286] gitaly[919]: time="2026-09-08T05:57:27.756Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFG9AND51ZF9ZS029P4YE error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-08T05:57:37.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:57:27.756" pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1696gitlab # [ 190.452247] gitaly[919]: time="2026-09-08T05:57:27.765Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFG9AND51ZF9ZS029P4YE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-08T05:57:37.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:57:27.756" grpc.time_ms=9.126 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1697gitlab # [ 190.543493] gitaly[919]: time="2026-09-08T05:57:27.871Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFG9AND51ZF9ZS029P4YE error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-08T05:57:37.120" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:57:27.871" pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1698gitlab # [ 190.565514] gitaly[919]: time="2026-09-08T05:57:27.872Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFG9AND51ZF9ZS029P4YE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-08T05:57:37.120" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:57:27.871" grpc.time_ms=0.486 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1699gitlab # [ 190.643485] gitaly[919]: time="2026-09-08T05:57:27.971Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFG9AND51ZF9ZS029P4YE diskcache=c9520d3c-4715-42c4-a1ee-5f7c3e553e0b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-08T05:57:37.167" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:57:27.917" pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1700gitlab # [ 190.665684] gitaly[919]: time="2026-09-08T05:57:27.972Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1583 command.oublock=32 command.real_time_ms=24 command.spawn_token_fork_ms=0 command.system_time_ms=13 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFG9AND51ZF9ZS029P4YE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-08T05:57:37.167" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:57:27.917" grpc.time_ms=54.219 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1701gitlab # [ 190.678322] gitaly[919]: time="2026-09-08T05:57:28.006Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFG9AND51ZF9ZS029P4YE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-08T05:57:38.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:57:28.006" pid=919 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1702gitlab # [ 190.679807] gitaly[919]: time="2026-09-08T05:57:28.006Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFG9AND51ZF9ZS029P4YE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-08T05:57:38.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:57:28.006" grpc.time_ms=0.687 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1703gitlab # [ 190.689389] gitaly[919]: time="2026-09-08T05:57:28.017Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFG9AND51ZF9ZS029P4YE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-08T05:57:38.010" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:57:28.011" grpc.time_ms=5.937 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1704gitlab # [ 190.749962] gitaly[919]: time="2026-09-08T05:57:28.078Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFG9AND51ZF9ZS029P4YE error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-08T05:57:38.077" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:57:28.078" pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1705gitlab # [ 190.750563] gitaly[919]: time="2026-09-08T05:57:28.078Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFG9AND51ZF9ZS029P4YE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-08T05:57:38.077" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:57:28.078" grpc.time_ms=0.218 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1706gitlab # [ 190.810377] gitaly[919]: time="2026-09-08T05:57:28.138Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFG9AND51ZF9ZS029P4YE diskcache=3174bae5-018b-4ccb-adcf-7ddf913ee155 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-08T05:57:38.100" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:57:28.100" pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1707gitlab # [ 190.810797] gitaly[919]: time="2026-09-08T05:57:28.139Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1575 command.oublock=32 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFG9AND51ZF9ZS029P4YE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-08T05:57:38.100" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:57:28.100" grpc.time_ms=38.447 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1708gitlab # [ 190.818934] gitaly[919]: time="2026-09-08T05:57:28.147Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFG9AND51ZF9ZS029P4YE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-08T05:57:38.146" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:57:28.146" pid=919 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1709gitlab # [ 190.819861] gitaly[919]: time="2026-09-08T05:57:28.147Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFG9AND51ZF9ZS029P4YE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-08T05:57:38.146" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:57:28.146" grpc.time_ms=0.347 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1710gitlab # [ 190.833478] gitaly[919]: time="2026-09-08T05:57:28.161Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFG9AND51ZF9ZS029P4YE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-08T05:57:38.152" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:57:28.152" grpc.time_ms=9.457 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1711gitlab # [ 190.865128] gitaly[919]: time="2026-09-08T05:57:28.192Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFG9AND51ZF9ZS029P4YE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-08T05:57:38.192" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:57:28.192" grpc.time_ms=0.108 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1712gitlab # [ 190.868434] gitaly[919]: time="2026-09-08T05:57:28.196Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFG9AND51ZF9ZS029P4YE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-08T05:57:38.196" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:57:28.196" grpc.time_ms=0.145 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1713gitlab # [ 191.328935] gitaly[919]: time="2026-09-08T05:57:28.657Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFG9AND51ZF9ZS029P4YE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-08T05:57:38.006" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:57:28.646" grpc.time_ms=10.302 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1714gitlab # [ 191.667670] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:57:28 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 20401715gitlab # [ 191.672684] setup-gitlab-start[2476]: {"id":1,"message":null,"error":null}1716gitlab # [ 192.438255] sidekiq-cluster[2464]: {"severity":"INFO","time":"2026-09-08T05:57:29.748Z","message":"Starting cluster with 1 processes"}1717gitlab # [ 196.947550] gitaly[919]: time="2026-09-08T05:57:34.275Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFQ67XDW9976E5RY95BYX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-08T05:57:44.003" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:57:34.263" grpc.time_ms=11.123 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1718gitlab # [ 197.345825] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:57:34 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 200 4924 "" "curl/8.21.0" 6501719gitlab # [ 197.353635] setup-gitlab-start[2199]: + mkdir -p /tmp/test-flake1720gitlab # [ 197.358433] setup-gitlab-start[2199]: + cd /tmp/test-flake1721gitlab # [ 197.358658] setup-gitlab-start[2199]: + git init -b master1722gitlab # [ 197.385773] setup-gitlab-start[2563]: Initialized empty Git repository in /tmp/test-flake/.git/1723gitlab # [ 197.388725] setup-gitlab-start[2199]: + git config user.name test1724gitlab # [ 197.390880] setup-gitlab-start[2199]: + git config user.email test@example.com1725gitlab # [ 197.393973] setup-gitlab-start[2199]: + cat1726gitlab # [ 197.397238] setup-gitlab-start[2199]: + git add flake.nix1727gitlab # [ 197.402415] setup-gitlab-start[2199]: + git commit -m 'initial commit'1728gitlab # [ 197.418201] setup-gitlab-start[2568]: [master (root-commit) ce6b2a8] initial commit1729gitlab # [ 197.418381] setup-gitlab-start[2568]: 1 file changed, 10 insertions(+)1730gitlab # [ 197.419478] setup-gitlab-start[2568]: create mode 100644 flake.nix1731gitlab # [ 197.421275] setup-gitlab-start[2199]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1732gitlab # [ 197.429244] setup-gitlab-start[2199]: + git push -u origin master1733gitlab # [ 197.490450] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:57:34 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 341734gitlab # [ 197.579283] gitaly[919]: time="2026-09-08T05:57:34.907Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSFQZ4KG7XDCVS3EJNAYY5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:57:34.897" grpc.time_ms=10.18 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1735gitlab # [ 197.608660] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:57:34 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 1161736gitlab # [ 197.818446] gitaly[919]: time="2026-09-08T05:57:35.146Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-08T05:57:45.004" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:57:35.134" grpc.time_ms=11.651 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1737gitlab # [ 197.887963] gitaly[919]: time="2026-09-08T05:57:35.216Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=332 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-08T05:58:05.007" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-08T05:57:35.208" grpc.time_ms=7.975 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1738gitlab # [ 197.918484] gitaly[919]: time="2026-09-08T05:57:35.246Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 duration_ms=180ns method=POST pid=919 status=200 url="http://unix/api/v4/internal/allowed"1739gitlab # [ 197.942467] gitaly[919]: time="2026-09-08T05:57:35.270Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 duration_ms=23ns method=POST pid=919 status=200 url="http://unix/api/v4/internal/pre_receive"1740gitlab # [ 197.949231] gitaly[919]: time="2026-09-08T05:57:35.271Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T05:57:35.066" grpc.time_ms=204.907 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1741gitlab # [ 198.008944] gitaly[919]: time="2026-09-08T05:57:35.337Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T05:57:35.336" grpc.time_ms=0.764 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1742gitlab # [ 198.072264] gitaly[919]: time="2026-09-08T05:57:35.399Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T05:57:35.399" grpc.time_ms=0.388 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1743gitlab # [ 198.105440] gitaly[919]: time="2026-09-08T05:57:35.433Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T05:57:35.431" grpc.time_ms=1.742 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1744gitlab # [ 198.186910] gitaly[919]: time="2026-09-08T05:57:35.515Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-08T05:57:45.005" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:57:35.505" grpc.time_ms=8.893 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1745gitlab # [ 198.213865] gitaly[919]: time="2026-09-08T05:57:35.532Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1556 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-08T05:57:45.019" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:57:35.519" grpc.time_ms=12.596 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1746gitlab # [ 198.232632] gitaly[919]: time="2026-09-08T05:57:35.542Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 duration_ms=82ns method=POST pid=919 status=200 url="http://unix/api/v4/internal/post_receive"1747gitlab # [ 198.235330] gitaly[919]: time="2026-09-08T05:57:35.543Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T05:57:35.460" grpc.time_ms=83.268 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1748gitlab # [ 198.252029] gitaly[919]: time="2026-09-08T05:57:35.580Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 diskcache=2b0db93d-130a-44b9-ab2a-4a9c9821637e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:57:35.002" pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1749gitlab # [ 198.261067] gitaly[919]: time="2026-09-08T05:57:35.580Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=181 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=892928 command.minflt=13235 command.oublock=32 command.real_time_ms=569 command.spawn_token_fork_ms=0 command.system_time_ms=106 command.user_time_ms=75 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:57:35.002" grpc.time_ms=578.231 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1750gitlab # [ 198.261389] gitlab-workhorse[834]: time="2026-09-08T05:57:35Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521751gitlab # [ 198.261950] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:57:35 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 6301752gitlab # [ 198.262917] setup-gitlab-start[2572]: To http://gitlab/root/test-flake.git1753gitlab # [ 198.263568] setup-gitlab-start[2572]: * [new branch] master -> master1754gitlab # [ 198.280920] setup-gitlab-start[2572]: branch 'master' set up to track 'origin/master'.1755gitlab # [ 198.284326] systemd[1]: Finished setup-gitlab.service.1756gitlab # [ 198.287788] systemd[1]: Starting nixbot CI service...1757gitlab: (finished: waiting for unit setup-gitlab.service, in 199.82 seconds)1758gitlab: waiting for unit nixbot.service1759gitlab # [ 199.416244] nixbot[2652]: {"ts": "2026-09-08T05:57:36.743Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1760gitlab # [ 199.447881] nixbot[2652]: {"ts": "2026-09-08T05:57:36.776Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1761gitlab # [ 199.473545] nixbot[2652]: {"ts": "2026-09-08T05:57:36.801Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1762gitlab # [ 199.480620] nixbot[2652]: {"ts": "2026-09-08T05:57:36.808Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1763gitlab # [ 199.485793] nixbot[2652]: {"ts": "2026-09-08T05:57:36.814Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1764gitlab # [ 199.495713] nixbot[2652]: {"ts": "2026-09-08T05:57:36.824Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1765gitlab # [ 199.501877] nixbot[2652]: {"ts": "2026-09-08T05:57:36.830Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1766gitlab # [ 199.507174] nixbot[2652]: {"ts": "2026-09-08T05:57:36.835Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1767gitlab # [ 199.516683] nixbot[2652]: {"ts": "2026-09-08T05:57:36.845Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1768gitlab # [ 199.523764] nixbot[2652]: {"ts": "2026-09-08T05:57:36.851Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1769gitlab # [ 199.534709] nixbot[2652]: {"ts": "2026-09-08T05:57:36.862Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1770gitlab # [ 199.541920] nixbot[2652]: {"ts": "2026-09-08T05:57:36.870Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1771gitlab # [ 199.546775] nixbot[2652]: {"ts": "2026-09-08T05:57:36.875Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1772gitlab # [ 199.551236] nixbot[2652]: {"ts": "2026-09-08T05:57:36.879Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1773gitlab # [ 199.556311] nixbot[2652]: {"ts": "2026-09-08T05:57:36.884Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1774gitlab # [ 199.560527] nixbot[2652]: {"ts": "2026-09-08T05:57:36.888Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1775gitlab # [ 199.564691] nixbot[2652]: {"ts": "2026-09-08T05:57:36.892Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1776gitlab # [ 199.568682] nixbot[2652]: {"ts": "2026-09-08T05:57:36.896Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1777gitlab # [ 199.577415] nixbot[2652]: {"ts": "2026-09-08T05:57:36.905Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1778gitlab # [ 199.581080] nixbot[2652]: {"ts": "2026-09-08T05:57:36.909Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1779gitlab # [ 199.584669] nixbot[2652]: {"ts": "2026-09-08T05:57:36.912Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1780gitlab # [ 199.592548] nixbot[2652]: {"ts": "2026-09-08T05:57:36.920Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1781gitlab # [ 199.596226] nixbot[2652]: {"ts": "2026-09-08T05:57:36.924Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1782gitlab # [ 199.600124] nixbot[2652]: {"ts": "2026-09-08T05:57:36.928Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1783gitlab # [ 199.603347] nixbot[2652]: {"ts": "2026-09-08T05:57:36.931Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1784gitlab # [ 199.608116] nixbot[2652]: {"ts": "2026-09-08T05:57:36.936Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1785gitlab # [ 199.611861] nixbot[2652]: {"ts": "2026-09-08T05:57:36.940Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1786gitlab # [ 199.615305] nixbot[2652]: {"ts": "2026-09-08T05:57:36.943Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1787gitlab # [ 199.618982] nixbot[2652]: {"ts": "2026-09-08T05:57:36.947Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"}1788gitlab # [ 199.636696] nixbot[2652]: {"ts": "2026-09-08T05:57:36.964Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"}1789gitlab # [ 199.645159] nixbot[2652]: {"ts": "2026-09-08T05:57:36.973Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 30, "migration": "work_retry"}1790gitlab # [ 199.649423] nixbot[2652]: {"ts": "2026-09-08T05:57:36.977Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"}1791gitlab # [ 199.655308] nixbot[2652]: {"ts": "2026-09-08T05:57:36.983Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 32, "migration": "upload_queue"}1792gitlab # [ 199.662077] nixbot[2652]: {"ts": "2026-09-08T05:57:36.990Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 33, "migration": "public_badges"}1793gitlab # [ 200.032258] nixbot[2652]: INFO: Started server process [2652]1794gitlab # [ 200.033298] nixbot[2652]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1795gitlab # [ 200.057189] nixbot[2652]: INFO: ::ffff:127.0.0.1:45604 - "GET /health HTTP/1.1" 200 OK1796gitlab # [ 200.063967] systemd[1]: Started nixbot CI service.1797gitlab # [ 200.067551] systemd[1]: Reached target Multi-User System.1798gitlab # [ 200.068725] systemd[1]: Startup finished in 1.225s (kernel) + 3.532s (initrd) + 3min 15.309s (userspace) = 3min 20.068s.1799gitlab: (finished: waiting for unit nixbot.service, in 1.05 seconds)1800gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1801gitlab # [ 200.281914] nixbot[2652]: INFO: ::ffff:127.0.0.1:45620 - "GET /health HTTP/1.1" 200 OK1802gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.03 seconds)1803subtest: project discovered and webhook registered1804gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1805gitlab # [ 200.300622] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:57:37 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 2461806gitlab # [ 200.301752] nixbot[2652]: {"ts": "2026-09-08T05:57:37.630Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1807gitlab # [ 200.315686] nixbot[2652]: {"ts": "2026-09-08T05:57:37.643Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1808gitlab # [ 200.370101] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:57:37 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 461809gitlab # [ 200.370311] nixbot[2652]: {"ts": "2026-09-08T05:57:37.696Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1810gitlab # [ 200.371041] nixbot[2652]: {"ts": "2026-09-08T05:57:37.697Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1811gitlab # [ 200.383725] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:57:37 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 511812gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.10 seconds)1813gitlab # [ 200.521786] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:57:37 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 918 "" "python-httpx/0.28.1" 1331814gitlab # [ 200.523673] nixbot[2652]: {"ts": "2026-09-08T05:57:37.851Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1815gitlab # [ 200.654956] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:57:37 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1221816gitlab # [ 200.661516] nixbot[2652]: {"ts": "2026-09-08T05:57:37.989Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1817gitlab # [ 200.745720] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:57:38 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "python-httpx/0.28.1" 661818gitlab # [ 200.751553] nixbot[2652]: {"ts": "2026-09-08T05:57:38.079Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1819gitlab # [ 200.868858] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:57:38 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 918 "" "python-httpx/0.28.1" 1071820gitlab # [ 200.874860] nixbot[2652]: {"ts": "2026-09-08T05:57:38.203Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1821gitlab # [ 200.973118] gitaly[919]: time="2026-09-08T05:57:38.301Z" level=info msg="finished unary call with code OK" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFV98RQ5TZ0WXHH03KDP6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-09-08T05:58:08.084" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:57:38.285" grpc.time_ms=15.305 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1822gitlab # [ 201.006895] gitaly[919]: time="2026-09-08T05:57:38.335Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFV98RQ5TZ0WXHH03KDP6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T05:58:08.133" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:57:38.334" grpc.time_ms=0.978 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1823gitlab # [ 201.039356] gitaly[919]: time="2026-09-08T05:57:38.367Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFV98RQ5TZ0WXHH03KDP6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-09-08T05:57:48.008" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:57:38.357" grpc.time_ms=10.353 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1824gitlab # [ 201.076304] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:57:38 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 1871825gitlab # [ 201.081510] nixbot[2652]: {"ts": "2026-09-08T05:57:38.409Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1826gitlab # [ 201.155619] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:57:38 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 691827gitlab # [ 201.156512] nixbot[2652]: {"ts": "2026-09-08T05:57:38.484Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1828gitlab # [ 201.168601] nixbot[2652]: {"ts": "2026-09-08T05:57:38.496Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1829gitlab # [ 201.266086] gitaly[919]: time="2026-09-08T05:57:38.594Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSFVKFR560ZPQ027436543 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:57:38.584" grpc.time_ms=9.412 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc1830gitlab # [ 201.266863] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:57:38 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 511831gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1832gitlab # [ 201.369555] gitaly[919]: time="2026-09-08T05:57:38.697Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFVP2DAFH5N6DKVMWVTX4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:57:38.685" pid=919 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1833gitlab # [ 201.369931] gitaly[919]: time="2026-09-08T05:57:38.698Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFVP2DAFH5N6DKVMWVTX4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:57:38.685" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc1834gitlab # [ 201.372287] gitaly[919]: time="2026-09-08T05:57:38.700Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFVP2DAFH5N6DKVMWVTX4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:57:38.685" grpc.time_ms=14.313 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc1835gitlab # [ 201.373487] gitlab-workhorse[834]: time="2026-09-08T05:57:38Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131836gitlab # [ 201.374673] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:57:38 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 741837gitlab # [ 201.469681] gitaly[919]: time="2026-09-08T05:57:38.798Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFVSD4HN2P5ZJZKN6H939 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:57:38.787" pid=919 remote_ip="2001:db8:1::1" request_sha=90edbf9abf2a83bbb36a320bab08cbe0b98a7756 response_bytes=222 span.kind=server system=grpc1838gitlab # [ 201.471394] gitaly[919]: time="2026-09-08T05:57:38.798Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1205 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFVSD4HN2P5ZJZKN6H939 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:57:38.787" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc1839gitlab # [ 201.472120] gitlab-workhorse[834]: time="2026-09-08T05:57:38Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2221840gitlab # [ 201.472613] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:57:38 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 222 "" "git/2.55.0" 651841gitlab # [ 201.473092] gitaly[919]: time="2026-09-08T05:57:38.799Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1205 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFVSD4HN2P5ZJZKN6H939 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:57:38.787" grpc.time_ms=10.849 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc1842gitlab # [ 201.529711] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:57:38 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "curl/8.21.0" 791843gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.14 seconds)1844(finished: subtest: project discovered and webhook registered, in 1.25 seconds)1845subtest: push delivers the webhook1846gitlab: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails'1847gitlab # [ 201.581275] gitaly[919]: time="2026-09-08T05:57:38.909Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSFVXPKG9767NSCZBTXXMW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:57:38.903" grpc.time_ms=5.786 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc1848gitlab # [ 201.581901] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:57:38 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 391849gitlab # [ 201.620979] gitaly[919]: time="2026-09-08T05:57:38.949Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFVYZDM3GMKA8FA1V7ZYF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:57:38.944" pid=919 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1850gitlab # [ 201.630033] gitaly[919]: time="2026-09-08T05:57:38.949Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFVYZDM3GMKA8FA1V7ZYF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:57:38.944" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc1851gitlab # [ 201.642295] gitlab-workhorse[834]: time="2026-09-08T05:57:38Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671852gitlab # [ 201.642732] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:57:38 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 381853gitlab # [ 201.643251] gitaly[919]: time="2026-09-08T05:57:38.949Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFVYZDM3GMKA8FA1V7ZYF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:57:38.944" grpc.time_ms=5.64 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc1854gitlab # [ 201.714904] gitaly[919]: time="2026-09-08T05:57:39.043Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSFW1ZS56CA99AKW9FNXM0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:57:39.036" grpc.time_ms=6.203 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc1855gitlab # [ 201.730599] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:57:39 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 511856gitlab # [ 201.779955] gitaly[919]: time="2026-09-08T05:57:39.108Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFW3MF42CY6ST6Z0KDS6T grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:57:39.093" pid=919 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1857gitlab # [ 201.780535] gitaly[919]: time="2026-09-08T05:57:39.108Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1173 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFW3MF42CY6ST6Z0KDS6T grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:57:39.093" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc1858gitlab # [ 201.781342] gitaly[919]: time="2026-09-08T05:57:39.108Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1173 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFW3MF42CY6ST6Z0KDS6T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:57:39.093" grpc.time_ms=14.901 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc1859gitlab # [ 201.782217] gitlab-workhorse[834]: time="2026-09-08T05:57:39Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091860gitlab # [ 201.783110] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:57:39 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 481861gitlab # [ 201.896992] gitaly[919]: time="2026-09-08T05:57:39.225Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFW7DEF2PAQ687ESSP0N1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T05:58:09.024" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:57:39.224" grpc.time_ms=0.486 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1862gitlab # [ 201.945396] gitaly[919]: time="2026-09-08T05:57:39.273Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSFW7DEF2PAQ687ESSP0N1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-08T05:58:09.066" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:57:39.266" grpc.time_ms=6.631 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1863gitlab # [ 201.962364] gitaly[919]: time="2026-09-08T05:57:39.290Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSFW7DEF2PAQ687ESSP0N1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T05:57:49.284" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:57:39.284" grpc.time_ms=5.691 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1864gitlab # [ 201.989627] gitaly[919]: time="2026-09-08T05:57:39.317Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSFW7DEF2PAQ687ESSP0N1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T05:57:49.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:57:39.309" grpc.time_ms=8.24 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1865gitlab # [ 202.036202] gitaly[919]: time="2026-09-08T05:57:39.364Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFW7DEF2PAQ687ESSP0N1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-08T05:57:49.033" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:57:39.364" grpc.time_ms=0.208 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1866gitlab # [ 202.057538] gitaly[919]: time="2026-09-08T05:57:39.385Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFW7DEF2PAQ687ESSP0N1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-08T05:57:49.048" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:57:39.379" grpc.time_ms=6.363 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1867gitlab # [ 202.118551] gitaly[919]: time="2026-09-08T05:57:39.446Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSFW7DEF2PAQ687ESSP0N1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T05:57:39.446" grpc.time_ms=0.321 pid=919 span.kind=server system=grpc1868gitlab # [ 202.154764] gitaly[919]: time="2026-09-08T05:57:39.482Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSFW7DEF2PAQ687ESSP0N1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T05:57:39.482" grpc.time_ms=0.553 pid=919 span.kind=server system=grpc1869gitlab # [ 202.172340] gitaly[919]: time="2026-09-08T05:57:39.500Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFW7DEF2PAQ687ESSP0N1 diskcache=9628a2bc-6215-487c-96c5-6666972f8226 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-08T05:57:49.067" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:57:39.398" pid=919 ref=refs/keep-around/ce6b2a812361f5f303208def21eaf41c3c3740b0 remote_ip="2001:db8:1::1" revision=ce6b2a812361f5f303208def21eaf41c3c3740b0 span.kind=server system=grpc username=root1870gitlab # [ 202.182460] gitaly[919]: time="2026-09-08T05:57:39.500Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=73 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5525 command.oublock=8 command.real_time_ms=93 command.spawn_token_fork_ms=0 command.system_time_ms=45 command.user_time_ms=28 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFW7DEF2PAQ687ESSP0N1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-08T05:57:49.067" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:57:39.398" grpc.time_ms=102.546 pid=919 ref=refs/keep-around/ce6b2a812361f5f303208def21eaf41c3c3740b0 remote_ip="2001:db8:1::1" revision=ce6b2a812361f5f303208def21eaf41c3c3740b0 span.kind=server system=grpc username=root1871gitlab # [ 202.198706] gitaly[919]: time="2026-09-08T05:57:39.527Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFW7DEF2PAQ687ESSP0N1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T05:58:09.326" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:57:39.526" grpc.time_ms=0.299 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1872gitlab # [ 202.430090] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:57:39 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/ce6b2a812361f5f303208def21eaf41c3c3740b0 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 5761873gitlab # [ 202.433166] nixbot[2652]: {"ts": "2026-09-08T05:57:39.761Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/ce6b2a812361f5f303208def21eaf41c3c3740b0 \"HTTP/1.1 201 Created\""}1874gitlab # [ 202.444751] nixbot[2652]: {"ts": "2026-09-08T05:57:39.773Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-ce6b2a812361-0"}1875gitlab # [ 202.599332] nixbot[2652]: {"ts": "2026-09-08T05:57:39.927Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-ce6b2a812361-0", "argv0": "bwrap"}1876gitlab # [ 202.669155] systemd[1]: Started Nix Daemon.1877gitlab # [ 202.734206] nix-daemon[2811]: accepted connection from pid 2806, user nixbot1878gitlab # [ 206.964854] nix-daemon[2811]: accepted connection from pid 2853, user nixbot1879gitlab # [ 206.978936] nix-daemon[2811]: accepted connection from pid 2806, user nixbot1880gitlab # [ 211.245753] nix-daemon[2811]: accepted connection from pid 2806, user nixbot1881gitlab # [ 211.340389] nix-daemon[2811]: accepted connection from pid 2896, user nixbot1882gitlab # [ 211.384768] gitaly[919]: time="2026-09-08T05:57:48.712Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSG5FG0DHDX3GA7J6GDZGK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T05:58:18.510" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:57:48.711" grpc.time_ms=0.888 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1883gitlab # [ 211.543473] gitaly[919]: time="2026-09-08T05:57:48.871Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSG5FG0DHDX3GA7J6GDZGK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T05:57:58.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:57:48.861" grpc.time_ms=10.446 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1884gitlab # [ 211.638778] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:57:48 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/ce6b2a812361f5f303208def21eaf41c3c3740b0 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 3091885gitlab # [ 211.645277] nixbot[2652]: {"ts": "2026-09-08T05:57:48.967Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/ce6b2a812361f5f303208def21eaf41c3c3740b0 \"HTTP/1.1 201 Created\""}1886gitlab # [ 211.678579] gitaly[919]: time="2026-09-08T05:57:49.006Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSG5S9PCNW1JG6GKSNG1H7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T05:58:19.005" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:57:49.005" grpc.time_ms=0.864 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1887gitlab # [ 211.737952] gitaly[919]: time="2026-09-08T05:57:49.066Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSG5S9PCNW1JG6GKSNG1H7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T05:57:59.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:57:49.055" grpc.time_ms=10.007 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1888gitlab # [ 211.802917] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:57:49 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/ce6b2a812361f5f303208def21eaf41c3c3740b0 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1601889gitlab # [ 211.808792] nixbot[2652]: {"ts": "2026-09-08T05:57:49.131Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/ce6b2a812361f5f303208def21eaf41c3c3740b0 \"HTTP/1.1 201 Created\""}1890gitlab # [ 215.819353] nix-daemon[2811]: accepted connection from pid 2964, user nixbot1891gitlab # [ 215.884496] gitaly[919]: time="2026-09-08T05:57:53.212Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSG9WK1DWS5RJ81FE4Q748 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T05:58:23.010" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:57:53.211" grpc.time_ms=0.851 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1892gitlab # [ 215.929238] gitaly[919]: time="2026-09-08T05:57:53.257Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSG9WK1DWS5RJ81FE4Q748 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T05:58:03.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:57:53.250" grpc.time_ms=6.646 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1893gitlab # [ 215.992614] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:57:53 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/ce6b2a812361f5f303208def21eaf41c3c3740b0 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1481894gitlab # [ 215.999297] nixbot[2652]: {"ts": "2026-09-08T05:57:53.321Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/ce6b2a812361f5f303208def21eaf41c3c3740b0 \"HTTP/1.1 201 Created\""}1895gitlab # [ 216.286820] gitaly[919]: time="2026-09-08T05:57:53.615Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSGA8ZHQRE0NNEZHSMKC7F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:57:53.605" grpc.time_ms=9.444 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc1896gitlab # [ 216.314984] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:57:53 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 751897gitlab # [ 216.386925] gitaly[919]: time="2026-09-08T05:57:53.715Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSGABG63KGKPB48RA340HR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:57:53.707" pid=919 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1898gitlab # [ 216.387214] gitaly[919]: time="2026-09-08T05:57:53.715Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSGABG63KGKPB48RA340HR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:57:53.707" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc1899gitlab # [ 216.387569] gitaly[919]: time="2026-09-08T05:57:53.715Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSGABG63KGKPB48RA340HR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:57:53.707" grpc.time_ms=8.427 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc1900gitlab # [ 216.442990] gitlab-workhorse[834]: time="2026-09-08T05:57:53Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671901gitlab # [ 216.443640] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:57:53 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1221902gitlab # [ 216.513770] gitaly[919]: time="2026-09-08T05:57:53.842Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSGAG95GJ1H6PBKRJFG4BQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:57:53.835" grpc.time_ms=6.551 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc1903gitlab # [ 216.518710] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:57:53 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 451904gitlab # [ 216.575337] gitaly[919]: time="2026-09-08T05:57:53.903Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSGAJ0YTH8WVPQDK5R6WMY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:57:53.895" pid=919 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc1905gitlab # [ 216.575575] gitaly[919]: time="2026-09-08T05:57:53.903Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSGAJ0YTH8WVPQDK5R6WMY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:57:53.895" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc1906gitlab # [ 216.576739] gitaly[919]: time="2026-09-08T05:57:53.904Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSGAJ0YTH8WVPQDK5R6WMY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:57:53.895" grpc.time_ms=8.07 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc1907gitlab # [ 216.577629] gitlab-workhorse[834]: time="2026-09-08T05:57:53Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671908gitlab # [ 216.578773] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:57:53 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 471909gitlab # [ 216.978650] sidekiq-cluster[2524]: 2026-09-08T05:57:54.306Z pid=2524 tid=xv8 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2524, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>434130944}1910gitlab # [ 217.146954] sidekiq-cluster[2524]: W, [2026-09-08T05:57:54.475066 #2524] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1911gitlab # [ 217.183497] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:57:54.511Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1912gitlab # [ 218.848770] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:57:56.176Z","message":"GitLab reliable fetch activated!"}1913gitlab # [ 218.849159] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:57:56.176Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1914gitlab # [ 237.967269] postgres[3196]: [3196] ERROR: relation "table_without_models" does not exist1915gitlab # [ 237.967716] postgres[3196]: [3196] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1916gitlab # [ 240.369193] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:17.697Z","message":"Booted Rails 7.2.3.1 application in production environment"}1917gitlab # [ 240.370326] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:17.698Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1918gitlab # [ 240.370887] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:17.699Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1919gitlab # [ 240.372061] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:17.699Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1920gitlab # [ 240.375958] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:17.704Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1921gitlab: (finished: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails', in 39.33 seconds)1922gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1923gitlab # [ 240.922572] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:58:18 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 221924gitlab # [ 240.982100] gitaly[919]: time="2026-09-08T05:58:18.310Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSH2CBMT0B1DCMAG7YK89B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:58:18.298" grpc.time_ms=11.674 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1925gitlab # [ 241.011167] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:58:18 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 201 "" "git/2.55.0" 881926gitlab # Enumerating objects: 5, done.1927gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1928gitlab # Delta compression using up to 4 threads1929gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1930gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 274 bytes | 274.00 KiB/s, done.1931gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1932gitlab # [ 241.222868] gitaly[919]: time="2026-09-08T05:58:18.551Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=328 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSH2FXPNQBQ3FEMA9YHRV4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-08T05:58:48.342" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-08T05:58:18.542" grpc.time_ms=8.272 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1933gitlab # [ 241.235600] gitaly[919]: time="2026-09-08T05:58:18.563Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1ZSH2FXPNQBQ3FEMA9YHRV4 duration_ms=71ns method=POST pid=919 status=200 url="http://unix/api/v4/internal/allowed"1934gitlab # [ 241.280584] gitaly[919]: time="2026-09-08T05:58:18.608Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1ZSH2FXPNQBQ3FEMA9YHRV4 duration_ms=44ns method=POST pid=919 status=200 url="http://unix/api/v4/internal/pre_receive"1935gitlab # [ 241.286802] gitaly[919]: time="2026-09-08T05:58:18.615Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSH2FXPNQBQ3FEMA9YHRV4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T05:58:18.492" grpc.time_ms=122.696 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1936gitlab # [ 241.328499] gitaly[919]: time="2026-09-08T05:58:18.656Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSH2FXPNQBQ3FEMA9YHRV4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T05:58:18.655" grpc.time_ms=0.742 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1937gitlab # [ 241.373119] gitaly[919]: time="2026-09-08T05:58:18.701Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSH2FXPNQBQ3FEMA9YHRV4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T05:58:18.700" grpc.time_ms=0.372 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1938gitlab # [ 241.403185] gitaly[919]: time="2026-09-08T05:58:18.731Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSH2FXPNQBQ3FEMA9YHRV4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T05:58:18.731" grpc.time_ms=0.407 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1939gitlab # [ 241.461713] gitaly[919]: time="2026-09-08T05:58:18.790Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1ZSH2FXPNQBQ3FEMA9YHRV4 duration_ms=30ns method=POST pid=919 status=200 url="http://unix/api/v4/internal/post_receive"1940gitlab # [ 241.462053] gitaly[919]: time="2026-09-08T05:58:18.790Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSH2FXPNQBQ3FEMA9YHRV4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T05:58:18.759" grpc.time_ms=30.747 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1941gitlab # [ 241.492621] gitaly[919]: time="2026-09-08T05:58:18.820Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSH2FXPNQBQ3FEMA9YHRV4 diskcache=e8325fe9-037c-4209-9ffb-2663cb7214f4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:58:18.417" pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1942gitlab # [ 241.492958] gitlab-workhorse[834]: time="2026-09-08T05:58:18Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521943gitlab # [ 241.493592] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:58:18 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 4551944gitlab # [ 241.504951] gitaly[919]: time="2026-09-08T05:58:18.833Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=201 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=880640 command.minflt=13797 command.oublock=32 command.real_time_ms=394 command.spawn_token_fork_ms=0 command.system_time_ms=128 command.user_time_ms=73 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSH2FXPNQBQ3FEMA9YHRV4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=606 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:58:18.417" grpc.time_ms=403.703 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1945gitlab # To http://gitlab/root/test-flake.git1946gitlab # ce6b2a8..900b614 master -> master1947gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.66 seconds)1948gitlab: must succeed: git -C /tmp/test-flake rev-parse master1949gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1950gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=900b61437f51ef58d953b2d67b98812ee58b53c9'1951gitlab # [ 241.586647] nixbot[2652]: INFO: ::ffff:127.0.0.1:44634 - "GET /api/repos/gitlab/root/test-flake/builds?commit=900b61437f51ef58d953b2d67b98812ee58b53c9 HTTP/1.1" 200 OK1952gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=900b61437f51ef58d953b2d67b98812ee58b53c9', in 0.06 seconds)1953gitlab # [ 241.691858] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:19.019Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"02d26c3c5902b8f38738d37d","created_at":"2026-09-08T05:57:28.032Z","trace_propagation_headers":{"sentry-trace":"98e2a983dbf649cca93aa0fda84e6ee8-786be3ec1e564282","baggage":"sentry-trace_id=98e2a983dbf649cca93aa0fda84e6ee8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSFG9AND51ZF9ZS029P4YE","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:28.064Z","job_size_bytes":2,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-02d26c3c5902b8f38738d37d: start","job_status":"start","queue_duration_s":50.955136,"scheduling_latency_s":50.95522}1954gitlab # [ 241.868887] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:19.196Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"02d26c3c5902b8f38738d37d","created_at":"2026-09-08T05:57:28.032Z","trace_propagation_headers":{"sentry-trace":"98e2a983dbf649cca93aa0fda84e6ee8-786be3ec1e564282","baggage":"sentry-trace_id=98e2a983dbf649cca93aa0fda84e6ee8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSFG9AND51ZF9ZS029P4YE","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:28.064Z","job_size_bytes":2,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-02d26c3c5902b8f38738d37d: done: 0.177521 sec","job_status":"done","queue_duration_s":50.955136,"scheduling_latency_s":50.95522,"redis_calls":25,"redis_duration_s":0.006239,"redis_read_bytes":912,"redis_write_bytes":2805,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.003631,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001512,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001096,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":11,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.060907,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.074013876,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.177521,"completed_at":"2026-09-08T05:58:19.196Z","load_balancing_strategy":"primary","db_duration_s":0.04998,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1955gitlab # [ 241.871502] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:19.197Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"c6cee43d2c79fb6cf5536a20","created_at":"2026-09-08T05:57:28.071Z","trace_propagation_headers":{"sentry-trace":"98e2a983dbf649cca93aa0fda84e6ee8-786be3ec1e564282","baggage":"sentry-trace_id=98e2a983dbf649cca93aa0fda84e6ee8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSFG9AND51ZF9ZS029P4YE","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:28.074Z","job_size_bytes":2,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-c6cee43d2c79fb6cf5536a20: start","job_status":"start","queue_duration_s":51.123068,"scheduling_latency_s":51.123084}1956gitlab # [ 241.946476] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:19.274Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"c6cee43d2c79fb6cf5536a20","created_at":"2026-09-08T05:57:28.071Z","trace_propagation_headers":{"sentry-trace":"98e2a983dbf649cca93aa0fda84e6ee8-786be3ec1e564282","baggage":"sentry-trace_id=98e2a983dbf649cca93aa0fda84e6ee8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSFG9AND51ZF9ZS029P4YE","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:28.074Z","job_size_bytes":2,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-c6cee43d2c79fb6cf5536a20: done: 0.076644 sec","job_status":"done","queue_duration_s":51.123068,"scheduling_latency_s":51.123084,"redis_calls":14,"redis_duration_s":0.003172,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000636,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001497,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001039,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047148,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.060566915,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.076644,"completed_at":"2026-09-08T05:58:19.274Z","load_balancing_strategy":"primary","db_duration_s":0.023236,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1957gitlab # [ 241.952144] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:19.275Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"7ccb6fd5be5bce585db51c6b","created_at":"2026-09-08T05:57:28.514Z","trace_propagation_headers":{"sentry-trace":"98e2a983dbf649cca93aa0fda84e6ee8-786be3ec1e564282","baggage":"sentry-trace_id=98e2a983dbf649cca93aa0fda84e6ee8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSFG9AND51ZF9ZS029P4YE","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:28.519Z","job_size_bytes":5,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-7ccb6fd5be5bce585db51c6b: start","job_status":"start","queue_duration_s":50.756776,"scheduling_latency_s":50.756791}1958gitlab # [ 242.062936] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:19.390Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"7ccb6fd5be5bce585db51c6b","created_at":"2026-09-08T05:57:28.514Z","trace_propagation_headers":{"sentry-trace":"98e2a983dbf649cca93aa0fda84e6ee8-786be3ec1e564282","baggage":"sentry-trace_id=98e2a983dbf649cca93aa0fda84e6ee8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSFG9AND51ZF9ZS029P4YE","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:28.519Z","job_size_bytes":5,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-7ccb6fd5be5bce585db51c6b: done: 0.115114 sec","job_status":"done","queue_duration_s":50.756776,"scheduling_latency_s":50.756791,"redis_calls":12,"redis_duration_s":0.0027,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000708,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001604,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000388,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.083167,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000360381,"duration_s":0.115114,"completed_at":"2026-09-08T05:58:19.390Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025125,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1959gitlab # [ 242.064465] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:19.392Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"b072bc7b09737d2bc0716f26","created_at":"2026-09-08T05:57:28.545Z","trace_propagation_headers":{"sentry-trace":"98e2a983dbf649cca93aa0fda84e6ee8-786be3ec1e564282","baggage":"sentry-trace_id=98e2a983dbf649cca93aa0fda84e6ee8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSFG9AND51ZF9ZS029P4YE","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:28.552Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-b072bc7b09737d2bc0716f26: start","job_status":"start","queue_duration_s":50.839547,"scheduling_latency_s":50.839563}1960gitlab # [ 242.219115] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:19.547Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"b072bc7b09737d2bc0716f26","created_at":"2026-09-08T05:57:28.545Z","trace_propagation_headers":{"sentry-trace":"98e2a983dbf649cca93aa0fda84e6ee8-786be3ec1e564282","baggage":"sentry-trace_id=98e2a983dbf649cca93aa0fda84e6ee8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSFG9AND51ZF9ZS029P4YE","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:28.552Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-b072bc7b09737d2bc0716f26: done: 0.154823 sec","job_status":"done","queue_duration_s":50.839547,"scheduling_latency_s":50.839563,"redis_calls":11,"redis_duration_s":0.002615,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000689,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001511,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000415,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.129,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.129,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.083717,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000347531,"duration_s":0.154823,"completed_at":"2026-09-08T05:58:19.547Z","load_balancing_strategy":"primary","db_duration_s":0.070122,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1961gitlab # [ 242.220504] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:19.548Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"9d03990f19684af6ef116664","created_at":"2026-09-08T05:57:28.556Z","trace_propagation_headers":{"sentry-trace":"98e2a983dbf649cca93aa0fda84e6ee8-786be3ec1e564282","baggage":"sentry-trace_id=98e2a983dbf649cca93aa0fda84e6ee8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSFG9AND51ZF9ZS029P4YE","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:28.562Z","job_size_bytes":89,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-9d03990f19684af6ef116664: start","job_status":"start","queue_duration_s":50.985976,"scheduling_latency_s":50.985995}1962gitlab # [ 242.298739] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:19.577Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"9d03990f19684af6ef116664","created_at":"2026-09-08T05:57:28.556Z","trace_propagation_headers":{"sentry-trace":"98e2a983dbf649cca93aa0fda84e6ee8-786be3ec1e564282","baggage":"sentry-trace_id=98e2a983dbf649cca93aa0fda84e6ee8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSFG9AND51ZF9ZS029P4YE","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:28.562Z","job_size_bytes":89,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-9d03990f19684af6ef116664: done: 0.029082 sec","job_status":"done","queue_duration_s":50.985976,"scheduling_latency_s":50.985995,"redis_calls":11,"redis_duration_s":0.00253,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000737,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001358,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000435,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016911,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000294451,"duration_s":0.029082,"completed_at":"2026-09-08T05:58:19.577Z","load_balancing_strategy":"primary","db_duration_s":0.005759,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1963gitlab # [ 242.351123] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:19.578Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 ce6b2a812361f5f303208def21eaf41c3c3740b0 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"22a2139390ab1b015827d926","created_at":"2026-09-08T05:57:35.491Z","trace_propagation_headers":{"sentry-trace":"7dfeaf199a324d26a27345c2f099034a-852cd4b1f3864616","baggage":"sentry-trace_id=7dfeaf199a324d26a27345c2f099034a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSFR36N5H00QAG8HS0GVC4","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:35.494Z","job_size_bytes":185,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-22a2139390ab1b015827d926: start","job_status":"start","queue_duration_s":44.08423,"scheduling_latency_s":44.084246}1964gitlab # [ 242.351940] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:19.590Z","message":"changes: \"0000000000000000000000000000000000000000 ce6b2a812361f5f303208def21eaf41c3c3740b0 refs/heads/master\\n\""}1965gitlab # [ 242.353645] gitaly[919]: time="2026-09-08T05:58:19.626Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T05:58:29.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:58:19.613" grpc.time_ms=13.429 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1966gitlab # [ 242.354444] gitaly[919]: time="2026-09-08T05:58:19.640Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-08T05:58:29.021" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:58:19.631" grpc.time_ms=8.898 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1967gitlab # [ 242.365287] gitaly[919]: time="2026-09-08T05:58:19.693Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-08T05:58:29.073" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:58:19.684" grpc.time_ms=9.161 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1968gitlab # [ 242.421233] gitaly[919]: time="2026-09-08T05:58:19.749Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3933 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T05:58:19.748" grpc.time_ms=1.186 pid=919 span.kind=server system=grpc1969gitlab # [ 242.462463] gitaly[919]: time="2026-09-08T05:58:19.790Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3935 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T05:58:19.790" grpc.time_ms=0.572 pid=919 span.kind=server system=grpc1970gitlab # [ 242.483657] gitaly[919]: time="2026-09-08T05:58:19.811Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 diskcache=bf42b8d8-ba17-4499-b8cb-b7119d657709 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-08T05:58:29.091" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:58:19.702" pid=919 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1971gitlab # [ 242.484314] gitaly[919]: time="2026-09-08T05:58:19.812Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=82 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5272 command.oublock=8 command.real_time_ms=100 command.spawn_token_fork_ms=0 command.system_time_ms=46 command.user_time_ms=36 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-08T05:58:29.091" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:58:19.702" grpc.time_ms=109.635 pid=919 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1972gitlab # [ 242.522268] gitaly[919]: time="2026-09-08T05:58:19.850Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-08T05:58:29.240" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:58:19.850" grpc.time_ms=0.131 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1973gitlab # [ 242.540617] gitaly[919]: time="2026-09-08T05:58:19.868Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=942 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-08T05:58:29.245" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:58:19.856" grpc.time_ms=12.588 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1974gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=900b61437f51ef58d953b2d67b98812ee58b53c9'1975gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=900b61437f51ef58d953b2d67b98812ee58b53c9', in 0.03 seconds)1976gitlab # [ 242.623127] nixbot[2652]: INFO: ::ffff:127.0.0.1:44642 - "GET /api/repos/gitlab/root/test-flake/builds?commit=900b61437f51ef58d953b2d67b98812ee58b53c9 HTTP/1.1" 200 OK1977gitlab # [ 242.631079] gitaly[919]: time="2026-09-08T05:58:19.959Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=343 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-09-08T05:58:49.052" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:19.953" grpc.time_ms=5.777 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1978gitlab # [ 242.655570] gitaly[919]: time="2026-09-08T05:58:19.983Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-08T05:58:29.003" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:58:19.983" grpc.time_ms=0.275 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1979gitlab # [ 242.664914] gitaly[919]: time="2026-09-08T05:58:19.993Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=341 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-08T05:58:29.006" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-09-08T05:58:19.986" grpc.time_ms=6.594 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1980gitlab # [ 242.697351] gitaly[919]: time="2026-09-08T05:58:20.025Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T05:58:30.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:58:20.016" grpc.time_ms=8.487 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1981gitlab # [ 242.719379] gitaly[919]: time="2026-09-08T05:58:20.047Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T05:58:30.031" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:58:20.042" grpc.time_ms=5.471 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1982gitlab # [ 242.757470] gitaly[919]: time="2026-09-08T05:58:20.085Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=966 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-08T05:58:50.069" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:20.069" grpc.time_ms=15.705 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1983gitlab # [ 243.123610] gitaly[919]: time="2026-09-08T05:58:20.451Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-08T05:58:30.010" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:20.450" grpc.time_ms=1.152 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1984gitlab # [ 243.171690] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:20.498Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 ce6b2a812361f5f303208def21eaf41c3c3740b0 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"22a2139390ab1b015827d926","created_at":"2026-09-08T05:57:35.491Z","trace_propagation_headers":{"sentry-trace":"7dfeaf199a324d26a27345c2f099034a-852cd4b1f3864616","baggage":"sentry-trace_id=7dfeaf199a324d26a27345c2f099034a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSFR36N5H00QAG8HS0GVC4","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:57:35.494Z","job_size_bytes":185,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-22a2139390ab1b015827d926: done: 0.91987 sec","job_status":"done","queue_duration_s":44.08423,"scheduling_latency_s":44.084246,"gitaly_calls":13,"gitaly_duration_s":0.269624,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.077965,"redis_read_bytes":2103,"redis_write_bytes":21750,"redis_cache_calls":15,"redis_cache_duration_s":0.005353,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.018875,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001522,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7838,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003123,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.033438,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.015654,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.048,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.179,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.201,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.048,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.491886,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000449219,"exclusive_lock_hold_duration_s":0.029985375,"duration_s":0.91987,"completed_at":"2026-09-08T05:58:20.498Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.087751,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1985gitlab # [ 243.247645] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:20.575Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"45d30601310d339bb1abab56","created_at":"2026-09-08T05:57:39.540Z","trace_propagation_headers":{"sentry-trace":"2daf7b7d213249298427194b84446ba0-c762094af71944fc","baggage":"sentry-trace_id=2daf7b7d213249298427194b84446ba0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSFW7DEF2PAQ687ESSP0N1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:39.546Z","job_size_bytes":65,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-45d30601310d339bb1abab56: start","job_status":"start","queue_duration_s":41.029579,"scheduling_latency_s":41.029613}1986gitlab # [ 243.347432] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:20.675Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"45d30601310d339bb1abab56","created_at":"2026-09-08T05:57:39.540Z","trace_propagation_headers":{"sentry-trace":"2daf7b7d213249298427194b84446ba0-c762094af71944fc","baggage":"sentry-trace_id=2daf7b7d213249298427194b84446ba0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSFW7DEF2PAQ687ESSP0N1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:39.546Z","job_size_bytes":65,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-45d30601310d339bb1abab56: done: 0.099796 sec","job_status":"done","queue_duration_s":41.029579,"scheduling_latency_s":41.029613,"redis_calls":16,"redis_duration_s":0.00623,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.003491,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00196,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000779,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.070673,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000294171,"duration_s":0.099796,"completed_at":"2026-09-08T05:58:20.675Z","load_balancing_strategy":"primary","db_duration_s":0.018378,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1987gitlab # [ 243.402286] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:20.676Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"c5016e6f5b3891652812754b","created_at":"2026-09-08T05:57:39.546Z","trace_propagation_headers":{"sentry-trace":"2daf7b7d213249298427194b84446ba0-c762094af71944fc","baggage":"sentry-trace_id=2daf7b7d213249298427194b84446ba0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSFW7DEF2PAQ687ESSP0N1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:39.549Z","job_size_bytes":65,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-c5016e6f5b3891652812754b: start","job_status":"start","queue_duration_s":41.126966,"scheduling_latency_s":41.12698}1988gitlab # [ 243.442523] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:20.770Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"c5016e6f5b3891652812754b","created_at":"2026-09-08T05:57:39.546Z","trace_propagation_headers":{"sentry-trace":"2daf7b7d213249298427194b84446ba0-c762094af71944fc","baggage":"sentry-trace_id=2daf7b7d213249298427194b84446ba0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSFW7DEF2PAQ687ESSP0N1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:39.549Z","job_size_bytes":65,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-c5016e6f5b3891652812754b: done: 0.093355 sec","job_status":"done","queue_duration_s":41.126966,"scheduling_latency_s":41.12698,"redis_calls":21,"redis_duration_s":0.0056430000000000004,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.002506,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001807,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00133,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050525,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00050593,"duration_s":0.093355,"completed_at":"2026-09-08T05:58:20.770Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.029904,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1989gitlab # [ 243.490604] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:20.818Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"8066a45b2cc4bbcea7df6335","created_at":"2026-09-08T05:57:39.741Z","trace_propagation_headers":{"sentry-trace":"2daf7b7d213249298427194b84446ba0-c762094af71944fc","baggage":"sentry-trace_id=2daf7b7d213249298427194b84446ba0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSFW7DEF2PAQ687ESSP0N1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:39.745Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-8066a45b2cc4bbcea7df6335: start","job_status":"start","queue_duration_s":41.072703,"scheduling_latency_s":41.072748}1990gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=900b61437f51ef58d953b2d67b98812ee58b53c9'1991gitlab # [ 243.655570] nixbot[2652]: INFO: ::ffff:127.0.0.1:33342 - "GET /api/repos/gitlab/root/test-flake/builds?commit=900b61437f51ef58d953b2d67b98812ee58b53c9 HTTP/1.1" 200 OK1992gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=900b61437f51ef58d953b2d67b98812ee58b53c9', in 0.04 seconds)1993gitlab # [ 243.692199] gitaly[919]: time="2026-09-08T05:58:21.018Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSFW7DEF2PAQ687ESSP0N1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T05:58:21.018" grpc.time_ms=0.777 pid=919 span.kind=server system=grpc1994gitlab # [ 243.747955] gitaly[919]: time="2026-09-08T05:58:21.076Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSFW7DEF2PAQ687ESSP0N1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T05:58:21.075" grpc.time_ms=0.565 pid=919 span.kind=server system=grpc1995gitlab # [ 243.798466] gitaly[919]: time="2026-09-08T05:58:21.126Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSFW7DEF2PAQ687ESSP0N1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T05:58:21.126" grpc.time_ms=0.381 pid=919 span.kind=server system=grpc1996gitlab # [ 243.825268] gitaly[919]: time="2026-09-08T05:58:21.153Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFW7DEF2PAQ687ESSP0N1 diskcache=886ab46a-1b10-44c2-9316-1d14393fc106 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-08T05:58:50.092" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:58:20.993" pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1997gitlab # [ 243.835492] gitaly[919]: time="2026-09-08T05:58:21.163Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=144 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7583 command.oublock=0 command.real_time_ms=152 command.spawn_token_fork_ms=1 command.system_time_ms=99 command.user_time_ms=45 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFW7DEF2PAQ687ESSP0N1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-08T05:58:50.092" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:58:20.993" grpc.time_ms=160.56 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1998gitlab # [ 243.936107] gitaly[919]: time="2026-09-08T05:58:21.264Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSFW7DEF2PAQ687ESSP0N1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-08T05:58:51.263" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:21.263" grpc.time_ms=0.659 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1999gitlab # [ 243.982514] gitaly[919]: time="2026-09-08T05:58:21.310Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFW7DEF2PAQ687ESSP0N1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T05:58:51.309" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:21.309" grpc.time_ms=0.911 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2000gitlab # [ 244.028789] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:21.355Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"8066a45b2cc4bbcea7df6335","created_at":"2026-09-08T05:57:39.741Z","trace_propagation_headers":{"sentry-trace":"2daf7b7d213249298427194b84446ba0-c762094af71944fc","baggage":"sentry-trace_id=2daf7b7d213249298427194b84446ba0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSFW7DEF2PAQ687ESSP0N1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:39.745Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2524,"job_status":"rescheduled","message":"PipelineProcessWorker JID-8066a45b2cc4bbcea7df6335: rescheduled"}2001gitlab # [ 244.043687] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:21.370Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"8066a45b2cc4bbcea7df6335","created_at":"2026-09-08T05:57:39.741Z","trace_propagation_headers":{"sentry-trace":"2daf7b7d213249298427194b84446ba0-c762094af71944fc","baggage":"sentry-trace_id=2daf7b7d213249298427194b84446ba0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSFW7DEF2PAQ687ESSP0N1","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-08T05:57:39.745Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-8066a45b2cc4bbcea7df6335: done: 0.552419 sec","job_status":"done","queue_duration_s":41.072703,"scheduling_latency_s":41.072748,"gitaly_calls":3,"gitaly_duration_s":0.209157,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.026161999999999998,"redis_read_bytes":460,"redis_write_bytes":29292,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001091,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.00146,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.009182,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.004102,"redis_queues_read_bytes":37,"redis_queues_write_bytes":15579,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.00648,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000456,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000566,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001734,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.046,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.014,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.017,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.02,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.268641,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.4787114,"duration_s":0.552419,"completed_at":"2026-09-08T05:58:21.370Z","load_balancing_strategy":"primary","db_duration_s":0.053669,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2002gitlab # [ 244.100991] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:21.373Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","ce6b2a812361f5f303208def21eaf41c3c3740b0 900b61437f51ef58d953b2d67b98812ee58b53c9 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"8bf09630e7e5640c447b87e1","created_at":"2026-09-08T05:58:18.779Z","trace_propagation_headers":{"sentry-trace":"99827f46f7244ab19936b371f219c011-a8f5452057b94983","baggage":"sentry-trace_id=99827f46f7244ab19936b371f219c011,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSH2FXPNQBQ3FEMA9YHRV4","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:18.780Z","job_size_bytes":185,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-8bf09630e7e5640c447b87e1: start","job_status":"start","queue_duration_s":2.592384,"scheduling_latency_s":2.592418}2003gitlab # [ 244.102093] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:21.389Z","message":"changes: \"ce6b2a812361f5f303208def21eaf41c3c3740b0 900b61437f51ef58d953b2d67b98812ee58b53c9 refs/heads/master\\n\""}2004gitlab # [ 244.103207] gitaly[919]: time="2026-09-08T05:58:21.418Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSH2FXPNQBQ3FEMA9YHRV4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T05:58:31.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:58:21.407" grpc.time_ms=10.685 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2005gitlab # [ 244.106227] gitaly[919]: time="2026-09-08T05:58:21.434Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSH2FXPNQBQ3FEMA9YHRV4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-08T05:58:31.023" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:58:21.424" grpc.time_ms=10.283 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2006gitlab # [ 244.115881] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:21.441Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"4e041a2f2a4d53cb1e16d4c1","created_at":"2026-09-08T05:58:21.439Z","trace_propagation_headers":{"sentry-trace":"99827f46f7244ab19936b371f219c011-4ab8beabd38e4a7a","baggage":"sentry-trace_id=99827f46f7244ab19936b371f219c011,sentry-release=Unknown"},"correlation_id":"01M1ZSH2FXPNQBQ3FEMA9YHRV4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"a15a40f2fdd2381d3d1e2ad7","job_size_bytes":46,"pid":2524,"job_status":"deduplicated","message":"ProjectCacheWorker JID-4e041a2f2a4d53cb1e16d4c1: deduplicated: until executing","deduplication.type":"until executing"}2007gitlab # [ 244.162658] gitaly[919]: time="2026-09-08T05:58:21.467Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSH2FXPNQBQ3FEMA9YHRV4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-08T05:58:31.018" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:58:21.459" grpc.time_ms=8.176 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2008gitlab # [ 244.163521] gitaly[919]: time="2026-09-08T05:58:21.478Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=654 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSH2FXPNQBQ3FEMA9YHRV4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-09-08T05:58:51.471" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:21.471" grpc.time_ms=6.708 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2009gitlab # [ 244.164234] gitaly[919]: time="2026-09-08T05:58:21.491Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=345 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSH2FXPNQBQ3FEMA9YHRV4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-08T05:58:31.045" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-09-08T05:58:21.485" grpc.time_ms=5.634 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2010gitlab # [ 244.177562] gitaly[919]: time="2026-09-08T05:58:21.505Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSH2FXPNQBQ3FEMA9YHRV4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T05:58:31.059" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:58:21.500" grpc.time_ms=5.669 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2011gitlab # [ 244.235964] gitaly[919]: time="2026-09-08T05:58:21.564Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSH2FXPNQBQ3FEMA9YHRV4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-08T05:58:31.122" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:21.563" grpc.time_ms=1.11 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2012gitlab # [ 244.253426] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:21.580Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","ce6b2a812361f5f303208def21eaf41c3c3740b0 900b61437f51ef58d953b2d67b98812ee58b53c9 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"8bf09630e7e5640c447b87e1","created_at":"2026-09-08T05:58:18.779Z","trace_propagation_headers":{"sentry-trace":"99827f46f7244ab19936b371f219c011-a8f5452057b94983","baggage":"sentry-trace_id=99827f46f7244ab19936b371f219c011,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSH2FXPNQBQ3FEMA9YHRV4","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-08T05:58:18.780Z","job_size_bytes":185,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-8bf09630e7e5640c447b87e1: done: 0.207465 sec","job_status":"done","queue_duration_s":2.592384,"scheduling_latency_s":2.592418,"gitaly_calls":7,"gitaly_duration_s":0.063492,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.018325,"redis_read_bytes":501,"redis_write_bytes":11944,"redis_cache_calls":9,"redis_cache_duration_s":0.001815,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.000729,"redis_queues_read_bytes":9,"redis_queues_write_bytes":5721,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002299,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.007873,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.005609,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.017,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.017,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.115522,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000631085,"exclusive_lock_hold_duration_s":0.020043609,"duration_s":0.207465,"completed_at":"2026-09-08T05:58:21.580Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.020052,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2013gitlab # [ 244.258542] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:21.583Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"a15a40f2fdd2381d3d1e2ad7","created_at":"2026-09-08T05:58:19.642Z","trace_propagation_headers":{"sentry-trace":"7dfeaf199a324d26a27345c2f099034a-0d85e881455642ec","baggage":"sentry-trace_id=7dfeaf199a324d26a27345c2f099034a,sentry-release=Unknown"},"correlation_id":"01M1ZSFR36N5H00QAG8HS0GVC4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:19.659Z","job_size_bytes":46,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-a15a40f2fdd2381d3d1e2ad7: start","job_status":"start","queue_duration_s":1.924068,"scheduling_latency_s":1.924107}2014gitlab # [ 244.305063] gitaly[919]: time="2026-09-08T05:58:21.620Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-09-08T11:58:21.617" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:58:21.617" grpc.time_ms=2.188 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2015gitlab # [ 244.342263] gitaly[919]: time="2026-09-08T05:58:21.670Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=650 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-08T05:58:51.663" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:21.663" grpc.time_ms=6.736 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2016gitlab # [ 244.361897] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:21.689Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"a15a40f2fdd2381d3d1e2ad7","created_at":"2026-09-08T05:58:19.642Z","trace_propagation_headers":{"sentry-trace":"7dfeaf199a324d26a27345c2f099034a-0d85e881455642ec","baggage":"sentry-trace_id=7dfeaf199a324d26a27345c2f099034a,sentry-release=Unknown"},"correlation_id":"01M1ZSFR36N5H00QAG8HS0GVC4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:19.659Z","job_size_bytes":46,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-a15a40f2fdd2381d3d1e2ad7: done: 0.106938 sec","job_status":"done","queue_duration_s":1.924068,"scheduling_latency_s":1.924107,"gitaly_calls":2,"gitaly_duration_s":0.050119,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.004901,"redis_read_bytes":69,"redis_write_bytes":4881,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.000821,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000362,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2114,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00134,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.001687,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":748,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000691,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041425,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000232711,"duration_s":0.106938,"completed_at":"2026-09-08T05:58:21.689Z","load_balancing_strategy":"primary","db_duration_s":0.008942,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2017gitlab # [ 244.365996] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:21.691Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"eeaa2547e5b69fc4021e04f2","created_at":"2026-09-08T05:58:19.672Z","trace_propagation_headers":{"sentry-trace":"7dfeaf199a324d26a27345c2f099034a-0d85e881455642ec","baggage":"sentry-trace_id=7dfeaf199a324d26a27345c2f099034a,sentry-release=Unknown"},"correlation_id":"01M1ZSFR36N5H00QAG8HS0GVC4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:19.676Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-eeaa2547e5b69fc4021e04f2: start","job_status":"start","queue_duration_s":2.014431,"scheduling_latency_s":2.014449}2018gitlab # [ 244.414971] gitaly[919]: time="2026-09-08T05:58:21.727Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 diskcache=51aa4e8e-f903-48da-8ceb-040f1d2ff1f6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-08T11:58:21.705" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:21.706" pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2019gitlab # [ 244.415821] gitaly[919]: time="2026-09-08T05:58:21.727Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1282 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-08T11:58:21.705" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:21.706" grpc.time_ms=20.889 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2020gitlab # [ 244.478651] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:21.806Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"eeaa2547e5b69fc4021e04f2","created_at":"2026-09-08T05:58:19.672Z","trace_propagation_headers":{"sentry-trace":"7dfeaf199a324d26a27345c2f099034a-0d85e881455642ec","baggage":"sentry-trace_id=7dfeaf199a324d26a27345c2f099034a,sentry-release=Unknown"},"correlation_id":"01M1ZSFR36N5H00QAG8HS0GVC4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:19.676Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-eeaa2547e5b69fc4021e04f2: done: 0.115571 sec","job_status":"done","queue_duration_s":2.014431,"scheduling_latency_s":2.014449,"gitaly_calls":1,"gitaly_duration_s":0.075516,"redis_calls":15,"redis_duration_s":0.002297,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000237,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000878,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000351,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000831,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.013,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025654,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.09995739599999999,"duration_s":0.115571,"completed_at":"2026-09-08T05:58:21.806Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010572,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2021gitlab # [ 244.481623] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:21.807Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"bd9b7761fcd683fca6a5b6be","created_at":"2026-09-08T05:58:19.846Z","trace_propagation_headers":{"sentry-trace":"7dfeaf199a324d26a27345c2f099034a-0d85e881455642ec","baggage":"sentry-trace_id=7dfeaf199a324d26a27345c2f099034a,sentry-release=Unknown"},"correlation_id":"01M1ZSFR36N5H00QAG8HS0GVC4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:19.848Z","job_size_bytes":23,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-bd9b7761fcd683fca6a5b6be: start","job_status":"start","queue_duration_s":1.959631,"scheduling_latency_s":1.959647}2022gitlab # [ 244.506201] gitaly[919]: time="2026-09-08T05:58:21.834Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=649 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-08T05:58:51.824" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:21.825" grpc.time_ms=8.879 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2023gitlab # [ 244.512881] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:21.841Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"bd9b7761fcd683fca6a5b6be","created_at":"2026-09-08T05:58:19.846Z","trace_propagation_headers":{"sentry-trace":"7dfeaf199a324d26a27345c2f099034a-0d85e881455642ec","baggage":"sentry-trace_id=7dfeaf199a324d26a27345c2f099034a,sentry-release=Unknown"},"correlation_id":"01M1ZSFR36N5H00QAG8HS0GVC4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:19.848Z","job_size_bytes":23,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-bd9b7761fcd683fca6a5b6be: done: 0.033259 sec","job_status":"done","queue_duration_s":1.959631,"scheduling_latency_s":1.959647,"gitaly_calls":1,"gitaly_duration_s":0.010961,"redis_calls":16,"redis_duration_s":0.003046,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000343,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000912,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.001299,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000492,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016708,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033259,"completed_at":"2026-09-08T05:58:21.841Z","load_balancing_strategy":"primary","db_duration_s":0.001629,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2024gitlab # [ 244.575413] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:21.842Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"b81e5776bb31c135fb847f11","created_at":"2026-09-08T05:58:20.325Z","trace_propagation_headers":{"sentry-trace":"7dfeaf199a324d26a27345c2f099034a-0d85e881455642ec","baggage":"sentry-trace_id=7dfeaf199a324d26a27345c2f099034a,sentry-release=Unknown"},"correlation_id":"01M1ZSFR36N5H00QAG8HS0GVC4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6805ae7fda440b703fcd17ec7d712bc5430bc22bb4704ab118320df1973c6bb","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:20.333Z","job_size_bytes":467,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-b81e5776bb31c135fb847f11: start","job_status":"start","queue_duration_s":1.509279,"scheduling_latency_s":1.509299}2025gitlab # [ 244.576346] gitaly[919]: time="2026-09-08T05:58:21.862Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T05:58:51.861" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:21.861" grpc.time_ms=0.512 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2026gitlab # [ 244.623921] gitaly[919]: time="2026-09-08T05:58:21.874Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-08T05:58:31.004" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:58:21.865" grpc.time_ms=9.617 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2027gitlab # [ 244.627071] gitaly[919]: time="2026-09-08T05:58:21.955Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-08T05:58:51.053" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:21.954" grpc.time_ms=1.267 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2028gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=900b61437f51ef58d953b2d67b98812ee58b53c9'2029gitlab # [ 244.633389] gitaly[919]: time="2026-09-08T05:58:21.961Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=201 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-08T05:58:51.057" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:21.958" grpc.time_ms=3.343 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2030gitlab # [ 244.696852] gitaly[919]: time="2026-09-08T05:58:22.024Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T05:58:32.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:58:22.018" grpc.time_ms=6.247 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2031gitlab # [ 244.701183] nixbot[2652]: INFO: ::ffff:127.0.0.1:33346 - "GET /api/repos/gitlab/root/test-flake/builds?commit=900b61437f51ef58d953b2d67b98812ee58b53c9 HTTP/1.1" 200 OK2032gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=900b61437f51ef58d953b2d67b98812ee58b53c9', in 0.05 seconds)2033gitlab # [ 245.143092] gitaly[919]: time="2026-09-08T05:58:22.471Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=960 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-08T05:58:52.053" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:22.453" grpc.time_ms=17.485 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2034gitlab # [ 245.154151] gitaly[919]: time="2026-09-08T05:58:22.482Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSFR36N5H00QAG8HS0GVC4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-08T05:58:52.072" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:22.473" grpc.time_ms=9.243 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2035gitlab # [ 245.236569] sidekiq-cluster[2524]: {"severity":"WARN","time":"2026-09-08T05:58:22.564Z","class":"CreatePipelineWorker","correlation_id":"01M1ZSFR36N5H00QAG8HS0GVC4","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"ce6b2a812361f5f303208def21eaf41c3c3740b0","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"ce6b2a812361f5f303208def21eaf41c3c3740b0","ref":"refs/heads/master"},"retry":0}2036gitlab # [ 245.246534] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:22.573Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"b81e5776bb31c135fb847f11","created_at":"2026-09-08T05:58:20.325Z","trace_propagation_headers":{"sentry-trace":"7dfeaf199a324d26a27345c2f099034a-0d85e881455642ec","baggage":"sentry-trace_id=7dfeaf199a324d26a27345c2f099034a,sentry-release=Unknown"},"correlation_id":"01M1ZSFR36N5H00QAG8HS0GVC4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6805ae7fda440b703fcd17ec7d712bc5430bc22bb4704ab118320df1973c6bb","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:20.333Z","job_size_bytes":467,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-b81e5776bb31c135fb847f11: done: 0.731068 sec","job_status":"done","queue_duration_s":1.509279,"scheduling_latency_s":1.509299,"gitaly_calls":7,"gitaly_duration_s":0.123568,"redis_calls":51,"redis_duration_s":0.011517,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.000793,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.005826,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00124,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002747,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000911,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.551086,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000479949,"duration_s":0.731068,"completed_at":"2026-09-08T05:58:22.573Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.050587,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2037gitlab # [ 245.314920] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:22.642Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"70419446-5324-4604-9036-16034cac128a\"}"],"class":"WebHookWorker","jid":"1e7dbd969a6b5c5c332d3f37","created_at":"2026-09-08T05:58:20.431Z","trace_propagation_headers":{"sentry-trace":"7dfeaf199a324d26a27345c2f099034a-0d85e881455642ec","baggage":"sentry-trace_id=7dfeaf199a324d26a27345c2f099034a,sentry-release=Unknown"},"correlation_id":"01M1ZSFR36N5H00QAG8HS0GVC4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b29865b3700b0b54094d5d2336cd98df8c0856736bb1d4809715ad12d4c93959","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:20.435Z","job_size_bytes":1751,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-1e7dbd969a6b5c5c332d3f37: start","job_status":"start","queue_duration_s":2.206603,"scheduling_latency_s":2.206652}2038gitlab # [ 245.474589] nixbot[2652]: INFO: ::ffff:127.0.0.1:33360 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2039gitlab # [ 245.498251] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:22.825Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"70419446-5324-4604-9036-16034cac128a\"}"],"class":"WebHookWorker","jid":"1e7dbd969a6b5c5c332d3f37","created_at":"2026-09-08T05:58:20.431Z","trace_propagation_headers":{"sentry-trace":"7dfeaf199a324d26a27345c2f099034a-0d85e881455642ec","baggage":"sentry-trace_id=7dfeaf199a324d26a27345c2f099034a,sentry-release=Unknown"},"correlation_id":"01M1ZSFR36N5H00QAG8HS0GVC4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b29865b3700b0b54094d5d2336cd98df8c0856736bb1d4809715ad12d4c93959","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:20.435Z","job_size_bytes":1751,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-1e7dbd969a6b5c5c332d3f37: done: 0.183128 sec","job_status":"done","queue_duration_s":2.206603,"scheduling_latency_s":2.206652,"redis_calls":19,"redis_duration_s":0.004506,"redis_read_bytes":32,"redis_write_bytes":5368,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001098,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000332,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3730,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001916,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00116,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.052520082999990336,"cpu_s":0.109372,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000383289,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.183128,"completed_at":"2026-09-08T05:58:22.825Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003833,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2040gitlab # [ 245.564446] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:22.828Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"99f1ddea042029e3655bd46b","created_at":"2026-09-08T05:58:20.976Z","trace_propagation_headers":{"sentry-trace":"2daf7b7d213249298427194b84446ba0-49cd314c9a064316","baggage":"sentry-trace_id=2daf7b7d213249298427194b84446ba0,sentry-release=Unknown"},"correlation_id":"01M1ZSFW7DEF2PAQ687ESSP0N1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:20.981Z","job_size_bytes":23,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-99f1ddea042029e3655bd46b: start","job_status":"start","queue_duration_s":1.847,"scheduling_latency_s":1.847035}2041gitlab # [ 245.572478] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:22.900Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"99f1ddea042029e3655bd46b","created_at":"2026-09-08T05:58:20.976Z","trace_propagation_headers":{"sentry-trace":"2daf7b7d213249298427194b84446ba0-49cd314c9a064316","baggage":"sentry-trace_id=2daf7b7d213249298427194b84446ba0,sentry-release=Unknown"},"correlation_id":"01M1ZSFW7DEF2PAQ687ESSP0N1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:20.981Z","job_size_bytes":23,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-99f1ddea042029e3655bd46b: done: 0.071995 sec","job_status":"done","queue_duration_s":1.847,"scheduling_latency_s":1.847035,"redis_calls":10,"redis_duration_s":0.002402,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000449,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001433,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00052,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049419,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000199187,"duration_s":0.071995,"completed_at":"2026-09-08T05:58:22.900Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015688,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2042gitlab # [ 245.583871] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:22.902Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"3f310904e4c88b03760ba750","created_at":"2026-09-08T05:58:21.168Z","trace_propagation_headers":{"sentry-trace":"2daf7b7d213249298427194b84446ba0-49cd314c9a064316","baggage":"sentry-trace_id=2daf7b7d213249298427194b84446ba0,sentry-release=Unknown"},"correlation_id":"01M1ZSFW7DEF2PAQ687ESSP0N1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:21.172Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-3f310904e4c88b03760ba750: start","job_status":"start","queue_duration_s":1.729318,"scheduling_latency_s":1.729332}2043gitlab # [ 245.598894] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:22.925Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"3f310904e4c88b03760ba750","created_at":"2026-09-08T05:58:21.168Z","trace_propagation_headers":{"sentry-trace":"2daf7b7d213249298427194b84446ba0-49cd314c9a064316","baggage":"sentry-trace_id=2daf7b7d213249298427194b84446ba0,sentry-release=Unknown"},"correlation_id":"01M1ZSFW7DEF2PAQ687ESSP0N1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:21.172Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-3f310904e4c88b03760ba750: done: 0.023731 sec","job_status":"done","queue_duration_s":1.729318,"scheduling_latency_s":1.729332,"redis_calls":10,"redis_duration_s":0.0021680000000000002,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000429,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001296,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000443,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013151,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000276572,"duration_s":0.023731,"completed_at":"2026-09-08T05:58:22.925Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005705,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2044gitlab # [ 245.646348] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:22.927Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"cd9a1647c36b9aa884e1370e","created_at":"2026-09-08T05:58:21.182Z","trace_propagation_headers":{"sentry-trace":"2daf7b7d213249298427194b84446ba0-49cd314c9a064316","baggage":"sentry-trace_id=2daf7b7d213249298427194b84446ba0,sentry-release=Unknown"},"correlation_id":"01M1ZSFW7DEF2PAQ687ESSP0N1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:21.193Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-cd9a1647c36b9aa884e1370e: start","job_status":"start","queue_duration_s":1.733852,"scheduling_latency_s":1.733866}2045gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=900b61437f51ef58d953b2d67b98812ee58b53c9'2046gitlab # [ 245.652879] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:22.951Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"cd9a1647c36b9aa884e1370e","created_at":"2026-09-08T05:58:21.182Z","trace_propagation_headers":{"sentry-trace":"2daf7b7d213249298427194b84446ba0-49cd314c9a064316","baggage":"sentry-trace_id=2daf7b7d213249298427194b84446ba0,sentry-release=Unknown"},"correlation_id":"01M1ZSFW7DEF2PAQ687ESSP0N1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:21.193Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-cd9a1647c36b9aa884e1370e: done: 0.024045 sec","job_status":"done","queue_duration_s":1.733852,"scheduling_latency_s":1.733866,"redis_calls":10,"redis_duration_s":0.0017729999999999998,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000403,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001053,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000317,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013813,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000200305,"duration_s":0.024045,"completed_at":"2026-09-08T05:58:22.951Z","load_balancing_strategy":"primary","db_duration_s":0.005599,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2047gitlab # [ 245.692979] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:22.952Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"7d40747a29047cd48dce7be0","created_at":"2026-09-08T05:58:21.209Z","trace_propagation_headers":{"sentry-trace":"2daf7b7d213249298427194b84446ba0-49cd314c9a064316","baggage":"sentry-trace_id=2daf7b7d213249298427194b84446ba0,sentry-release=Unknown"},"correlation_id":"01M1ZSFW7DEF2PAQ687ESSP0N1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:21.215Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-7d40747a29047cd48dce7be0: start","job_status":"start","queue_duration_s":1.736481,"scheduling_latency_s":1.736495}2048gitlab # [ 245.732075] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:23.017Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"7d40747a29047cd48dce7be0","created_at":"2026-09-08T05:58:21.209Z","trace_propagation_headers":{"sentry-trace":"2daf7b7d213249298427194b84446ba0-49cd314c9a064316","baggage":"sentry-trace_id=2daf7b7d213249298427194b84446ba0,sentry-release=Unknown"},"correlation_id":"01M1ZSFW7DEF2PAQ687ESSP0N1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:21.215Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-7d40747a29047cd48dce7be0: done: 0.065666 sec","job_status":"done","queue_duration_s":1.736481,"scheduling_latency_s":1.736495,"redis_calls":13,"redis_duration_s":0.001695,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000239,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000732,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000401,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000323,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014583,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000201981,"duration_s":0.065666,"completed_at":"2026-09-08T05:58:23.017Z","load_balancing_strategy":"primary","db_duration_s":0.005761,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2049gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=900b61437f51ef58d953b2d67b98812ee58b53c9', in 0.07 seconds)2050gitlab # [ 245.744218] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:23.020Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"6b00b388fdede8f44da7279c","created_at":"2026-09-08T05:58:21.216Z","trace_propagation_headers":{"sentry-trace":"2daf7b7d213249298427194b84446ba0-49cd314c9a064316","baggage":"sentry-trace_id=2daf7b7d213249298427194b84446ba0,sentry-release=Unknown"},"correlation_id":"01M1ZSFW7DEF2PAQ687ESSP0N1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:21.221Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-6b00b388fdede8f44da7279c: start","job_status":"start","queue_duration_s":1.799491,"scheduling_latency_s":1.79951}2051gitlab # [ 245.759602] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:23.044Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"6b00b388fdede8f44da7279c","created_at":"2026-09-08T05:58:21.216Z","trace_propagation_headers":{"sentry-trace":"2daf7b7d213249298427194b84446ba0-49cd314c9a064316","baggage":"sentry-trace_id=2daf7b7d213249298427194b84446ba0,sentry-release=Unknown"},"correlation_id":"01M1ZSFW7DEF2PAQ687ESSP0N1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:21.221Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-6b00b388fdede8f44da7279c: done: 0.024061 sec","job_status":"done","queue_duration_s":1.799491,"scheduling_latency_s":1.79951,"redis_calls":10,"redis_duration_s":0.001264,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000258,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000764,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000242,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014339,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000198908,"duration_s":0.024061,"completed_at":"2026-09-08T05:58:23.044Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005476,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2052gitlab # [ 245.806783] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:23.045Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"6829abb1013bb269578d0327","created_at":"2026-09-08T05:58:21.221Z","trace_propagation_headers":{"sentry-trace":"2daf7b7d213249298427194b84446ba0-49cd314c9a064316","baggage":"sentry-trace_id=2daf7b7d213249298427194b84446ba0,sentry-release=Unknown"},"correlation_id":"01M1ZSFW7DEF2PAQ687ESSP0N1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:21.227Z","job_size_bytes":19,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-6829abb1013bb269578d0327: start","job_status":"start","queue_duration_s":1.818044,"scheduling_latency_s":1.818057}2053gitlab # [ 245.850350] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:23.076Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"6829abb1013bb269578d0327","created_at":"2026-09-08T05:58:21.221Z","trace_propagation_headers":{"sentry-trace":"2daf7b7d213249298427194b84446ba0-49cd314c9a064316","baggage":"sentry-trace_id=2daf7b7d213249298427194b84446ba0,sentry-release=Unknown"},"correlation_id":"01M1ZSFW7DEF2PAQ687ESSP0N1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:21.227Z","job_size_bytes":19,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-6829abb1013bb269578d0327: done: 0.030906 sec","job_status":"done","queue_duration_s":1.818044,"scheduling_latency_s":1.818057,"redis_calls":11,"redis_duration_s":0.003331,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000503,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002363,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000465,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016701,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000516825,"duration_s":0.030906,"completed_at":"2026-09-08T05:58:23.076Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004955,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2054gitlab # [ 245.852671] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:23.079Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"25d88ceca038a8b0001b9aed","created_at":"2026-09-08T05:58:21.230Z","trace_propagation_headers":{"sentry-trace":"2daf7b7d213249298427194b84446ba0-49cd314c9a064316","baggage":"sentry-trace_id=2daf7b7d213249298427194b84446ba0,sentry-release=Unknown"},"correlation_id":"01M1ZSFW7DEF2PAQ687ESSP0N1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:21.233Z","job_size_bytes":66,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-25d88ceca038a8b0001b9aed: start","job_status":"start","queue_duration_s":1.845406,"scheduling_latency_s":1.84544}2055gitlab # [ 245.868748] nixbot[2652]: INFO: ::ffff:127.0.0.1:33372 - "GET /api/repos/gitlab/root/test-flake/builds?commit=900b61437f51ef58d953b2d67b98812ee58b53c9 HTTP/1.1" 200 OK2056gitlab # [ 245.870045] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:23.113Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"25d88ceca038a8b0001b9aed","created_at":"2026-09-08T05:58:21.230Z","trace_propagation_headers":{"sentry-trace":"2daf7b7d213249298427194b84446ba0-49cd314c9a064316","baggage":"sentry-trace_id=2daf7b7d213249298427194b84446ba0,sentry-release=Unknown"},"correlation_id":"01M1ZSFW7DEF2PAQ687ESSP0N1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:21.233Z","job_size_bytes":66,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-25d88ceca038a8b0001b9aed: done: 0.03401 sec","job_status":"done","queue_duration_s":1.845406,"scheduling_latency_s":1.84544,"redis_calls":10,"redis_duration_s":0.002757,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000643,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001714,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0004,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020272,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022461,"duration_s":0.03401,"completed_at":"2026-09-08T05:58:23.113Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004778,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2057gitlab # [ 245.913801] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:23.114Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"b6c10f81de223b230e641ef8","created_at":"2026-09-08T05:58:21.234Z","trace_propagation_headers":{"sentry-trace":"2daf7b7d213249298427194b84446ba0-49cd314c9a064316","baggage":"sentry-trace_id=2daf7b7d213249298427194b84446ba0,sentry-release=Unknown"},"correlation_id":"01M1ZSFW7DEF2PAQ687ESSP0N1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:21.236Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-b6c10f81de223b230e641ef8: start","job_status":"start","queue_duration_s":1.877412,"scheduling_latency_s":1.877426}2058gitlab # [ 245.953895] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:23.138Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"b6c10f81de223b230e641ef8","created_at":"2026-09-08T05:58:21.234Z","trace_propagation_headers":{"sentry-trace":"2daf7b7d213249298427194b84446ba0-49cd314c9a064316","baggage":"sentry-trace_id=2daf7b7d213249298427194b84446ba0,sentry-release=Unknown"},"correlation_id":"01M1ZSFW7DEF2PAQ687ESSP0N1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:21.236Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-b6c10f81de223b230e641ef8: done: 0.023832 sec","job_status":"done","queue_duration_s":1.877412,"scheduling_latency_s":1.877426,"redis_calls":10,"redis_duration_s":0.0012490000000000001,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000238,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000768,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000243,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0168,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000234107,"duration_s":0.023832,"completed_at":"2026-09-08T05:58:23.138Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002853,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2059gitlab # [ 245.993734] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:23.138Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"b62fdb2b103c5628d3b2a5fd","created_at":"2026-09-08T05:58:21.240Z","trace_propagation_headers":{"sentry-trace":"2daf7b7d213249298427194b84446ba0-49cd314c9a064316","baggage":"sentry-trace_id=2daf7b7d213249298427194b84446ba0,sentry-release=Unknown"},"correlation_id":"01M1ZSFW7DEF2PAQ687ESSP0N1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:21.242Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-b62fdb2b103c5628d3b2a5fd: start","job_status":"start","queue_duration_s":1.896227,"scheduling_latency_s":1.896241}2060gitlab # [ 245.994726] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:23.161Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"b62fdb2b103c5628d3b2a5fd","created_at":"2026-09-08T05:58:21.240Z","trace_propagation_headers":{"sentry-trace":"2daf7b7d213249298427194b84446ba0-49cd314c9a064316","baggage":"sentry-trace_id=2daf7b7d213249298427194b84446ba0,sentry-release=Unknown"},"correlation_id":"01M1ZSFW7DEF2PAQ687ESSP0N1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:21.242Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-b62fdb2b103c5628d3b2a5fd: done: 0.022192 sec","job_status":"done","queue_duration_s":1.896227,"scheduling_latency_s":1.896241,"redis_calls":10,"redis_duration_s":0.001443,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000448,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000741,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000254,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011955,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000204775,"duration_s":0.022192,"completed_at":"2026-09-08T05:58:23.161Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005796,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2061gitlab # [ 246.051339] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:23.161Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"a5f436c881f1216f9c8d96dd","created_at":"2026-09-08T05:58:21.243Z","trace_propagation_headers":{"sentry-trace":"2daf7b7d213249298427194b84446ba0-49cd314c9a064316","baggage":"sentry-trace_id=2daf7b7d213249298427194b84446ba0,sentry-release=Unknown"},"correlation_id":"01M1ZSFW7DEF2PAQ687ESSP0N1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:21.246Z","job_size_bytes":6,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-a5f436c881f1216f9c8d96dd: start","job_status":"start","queue_duration_s":1.915809,"scheduling_latency_s":1.915823}2062gitlab # [ 246.052145] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:23.175Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"a5f436c881f1216f9c8d96dd","created_at":"2026-09-08T05:58:21.243Z","trace_propagation_headers":{"sentry-trace":"2daf7b7d213249298427194b84446ba0-49cd314c9a064316","baggage":"sentry-trace_id=2daf7b7d213249298427194b84446ba0,sentry-release=Unknown"},"correlation_id":"01M1ZSFW7DEF2PAQ687ESSP0N1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:21.246Z","job_size_bytes":6,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-a5f436c881f1216f9c8d96dd: done: 0.013535 sec","job_status":"done","queue_duration_s":1.915809,"scheduling_latency_s":1.915823,"redis_calls":10,"redis_duration_s":0.001396,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000319,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000817,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00026,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007793,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000197511,"duration_s":0.013535,"completed_at":"2026-09-08T05:58:23.175Z","load_balancing_strategy":"primary","db_duration_s":0.001453,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2063gitlab # [ 246.093419] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:23.176Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"740b43a3b4aa7a2b5e32dd5e","created_at":"2026-09-08T05:58:21.246Z","trace_propagation_headers":{"sentry-trace":"2daf7b7d213249298427194b84446ba0-49cd314c9a064316","baggage":"sentry-trace_id=2daf7b7d213249298427194b84446ba0,sentry-release=Unknown"},"correlation_id":"01M1ZSFW7DEF2PAQ687ESSP0N1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:21.249Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-740b43a3b4aa7a2b5e32dd5e: start","job_status":"start","queue_duration_s":1.927071,"scheduling_latency_s":1.927084}2064gitlab # [ 246.094515] gitaly[919]: time="2026-09-08T05:58:23.348Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSH2FXPNQBQ3FEMA9YHRV4 diskcache=bcfd9cca-946d-4dde-a638-871bcf27f47c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-08T11:58:23.262" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:23.262" pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2065gitlab # [ 246.095160] gitaly[919]: time="2026-09-08T05:58:23.349Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=316 command.oublock=0 command.real_time_ms=80 command.spawn_token_fork_ms=77 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSH2FXPNQBQ3FEMA9YHRV4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-08T11:58:23.262" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:23.262" grpc.time_ms=86.309 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2066gitlab # [ 246.106122] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:23.197Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"740b43a3b4aa7a2b5e32dd5e","created_at":"2026-09-08T05:58:21.246Z","trace_propagation_headers":{"sentry-trace":"2daf7b7d213249298427194b84446ba0-49cd314c9a064316","baggage":"sentry-trace_id=2daf7b7d213249298427194b84446ba0,sentry-release=Unknown"},"correlation_id":"01M1ZSFW7DEF2PAQ687ESSP0N1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:21.249Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-740b43a3b4aa7a2b5e32dd5e: done: 0.020788 sec","job_status":"done","queue_duration_s":1.927071,"scheduling_latency_s":1.927084,"redis_calls":10,"redis_duration_s":0.001248,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000245,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000767,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000236,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01261,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000189689,"duration_s":0.020788,"completed_at":"2026-09-08T05:58:23.197Z","load_balancing_strategy":"primary","db_duration_s":0.003988,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2067gitlab # [ 246.144639] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:23.198Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"ba2c631eaf7b2463c9e1e606","created_at":"2026-09-08T05:58:21.252Z","trace_propagation_headers":{"sentry-trace":"2daf7b7d213249298427194b84446ba0-49cd314c9a064316","baggage":"sentry-trace_id=2daf7b7d213249298427194b84446ba0,sentry-release=Unknown"},"correlation_id":"01M1ZSFW7DEF2PAQ687ESSP0N1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:21.255Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-ba2c631eaf7b2463c9e1e606: start","job_status":"start","queue_duration_s":1.942762,"scheduling_latency_s":1.942775}2068gitlab # [ 246.190272] gitaly[919]: time="2026-09-08T05:58:23.377Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSH2FXPNQBQ3FEMA9YHRV4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T05:58:53.076" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:23.376" grpc.time_ms=0.517 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2069gitlab # [ 246.190912] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:23.234Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"ba2c631eaf7b2463c9e1e606","created_at":"2026-09-08T05:58:21.252Z","trace_propagation_headers":{"sentry-trace":"2daf7b7d213249298427194b84446ba0-49cd314c9a064316","baggage":"sentry-trace_id=2daf7b7d213249298427194b84446ba0,sentry-release=Unknown"},"correlation_id":"01M1ZSFW7DEF2PAQ687ESSP0N1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:21.255Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-ba2c631eaf7b2463c9e1e606: done: 0.036633 sec","job_status":"done","queue_duration_s":1.942762,"scheduling_latency_s":1.942775,"redis_calls":14,"redis_duration_s":0.001974,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000234,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000907,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000833,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023624,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000283835,"duration_s":0.036633,"completed_at":"2026-09-08T05:58:23.234Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007406,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2070gitlab # [ 246.229100] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:23.235Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"d215b051fabce9f0825009fc","created_at":"2026-09-08T05:58:21.357Z","trace_propagation_headers":{"sentry-trace":"2daf7b7d213249298427194b84446ba0-49cd314c9a064316","baggage":"sentry-trace_id=2daf7b7d213249298427194b84446ba0,sentry-release=Unknown"},"correlation_id":"01M1ZSFW7DEF2PAQ687ESSP0N1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:21.360Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d215b051fabce9f0825009fc: start","job_status":"start","queue_duration_s":1.875268,"scheduling_latency_s":1.875281}2071gitlab # [ 246.229778] gitaly[919]: time="2026-09-08T05:58:23.385Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSH2FXPNQBQ3FEMA9YHRV4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-08T05:58:33.009" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:58:23.380" grpc.time_ms=5.028 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2072gitlab # [ 246.231830] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:23.250Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"d215b051fabce9f0825009fc","created_at":"2026-09-08T05:58:21.357Z","trace_propagation_headers":{"sentry-trace":"2daf7b7d213249298427194b84446ba0-49cd314c9a064316","baggage":"sentry-trace_id=2daf7b7d213249298427194b84446ba0,sentry-release=Unknown"},"correlation_id":"01M1ZSFW7DEF2PAQ687ESSP0N1","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:21.360Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d215b051fabce9f0825009fc: done: 0.01528 sec","job_status":"done","queue_duration_s":1.875268,"scheduling_latency_s":1.875281,"redis_calls":8,"redis_duration_s":0.001,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000772,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000228,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010364,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01528,"completed_at":"2026-09-08T05:58:23.250Z","load_balancing_strategy":"primary","db_duration_s":0.002201,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2073gitlab # [ 246.290792] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:23.251Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"cc3e653118fe08d33b042629","created_at":"2026-09-08T05:58:21.449Z","trace_propagation_headers":{"sentry-trace":"99827f46f7244ab19936b371f219c011-4ab8beabd38e4a7a","baggage":"sentry-trace_id=99827f46f7244ab19936b371f219c011,sentry-release=Unknown"},"correlation_id":"01M1ZSH2FXPNQBQ3FEMA9YHRV4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"eeaa2547e5b69fc4021e04f2","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:21.452Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-cc3e653118fe08d33b042629: start","job_status":"start","queue_duration_s":1.79922,"scheduling_latency_s":1.799235}2074gitlab # [ 246.291704] gitaly[919]: time="2026-09-08T05:58:23.407Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSH2FXPNQBQ3FEMA9YHRV4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-08T05:58:53.006" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:23.406" grpc.time_ms=0.574 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2075gitlab # [ 246.294675] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:23.361Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"cc3e653118fe08d33b042629","created_at":"2026-09-08T05:58:21.449Z","trace_propagation_headers":{"sentry-trace":"99827f46f7244ab19936b371f219c011-4ab8beabd38e4a7a","baggage":"sentry-trace_id=99827f46f7244ab19936b371f219c011,sentry-release=Unknown"},"correlation_id":"01M1ZSH2FXPNQBQ3FEMA9YHRV4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"eeaa2547e5b69fc4021e04f2","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:21.452Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-cc3e653118fe08d33b042629: done: 0.109667 sec","job_status":"done","queue_duration_s":1.79922,"scheduling_latency_s":1.799235,"gitaly_calls":1,"gitaly_duration_s":0.088382,"redis_calls":12,"redis_duration_s":0.001968,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000349,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000685,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016276,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.098158285,"duration_s":0.109667,"completed_at":"2026-09-08T05:58:23.361Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003034,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2076gitlab # [ 246.372994] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:23.362Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"07a656a604f42f4d01ed433d","created_at":"2026-09-08T05:58:21.542Z","trace_propagation_headers":{"sentry-trace":"99827f46f7244ab19936b371f219c011-4ab8beabd38e4a7a","baggage":"sentry-trace_id=99827f46f7244ab19936b371f219c011,sentry-release=Unknown"},"correlation_id":"01M1ZSH2FXPNQBQ3FEMA9YHRV4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5324a94206c07c07044341c95aa6b42a42544039d9ebed216e32b65145f8c454","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:21.544Z","job_size_bytes":467,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-07a656a604f42f4d01ed433d: start","job_status":"start","queue_duration_s":1.818141,"scheduling_latency_s":1.818156}2077gitlab # [ 246.373753] gitaly[919]: time="2026-09-08T05:58:23.412Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=42 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSH2FXPNQBQ3FEMA9YHRV4 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-08T05:58:53.010" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:23.411" grpc.time_ms=1.591 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2078gitlab # [ 246.374493] gitaly[919]: time="2026-09-08T05:58:23.435Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSH2FXPNQBQ3FEMA9YHRV4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T05:58:33.059" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:58:23.429" grpc.time_ms=5.571 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2079gitlab # [ 246.462364] gitaly[919]: time="2026-09-08T05:58:23.790Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=964 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSH2FXPNQBQ3FEMA9YHRV4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-08T05:58:53.381" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:23.781" grpc.time_ms=8.912 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2080gitlab # [ 246.469166] gitaly[919]: time="2026-09-08T05:58:23.797Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSH7R5RJBDHMK9B3RKZ2DX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:58:23.791" grpc.time_ms=5.803 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc2081gitlab # [ 246.470317] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:58:23 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 492082gitlab # [ 246.474518] gitaly[919]: time="2026-09-08T05:58:23.802Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSH2FXPNQBQ3FEMA9YHRV4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-08T05:58:53.393" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:23.793" grpc.time_ms=8.89 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2083gitlab # [ 246.483804] sidekiq-cluster[2524]: {"severity":"WARN","time":"2026-09-08T05:58:23.812Z","class":"CreatePipelineWorker","correlation_id":"01M1ZSH2FXPNQBQ3FEMA9YHRV4","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"ce6b2a812361f5f303208def21eaf41c3c3740b0","after":"900b61437f51ef58d953b2d67b98812ee58b53c9","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"900b61437f51ef58d953b2d67b98812ee58b53c9","ref":"refs/heads/master"},"retry":0}2084gitlab # [ 246.487931] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:23.816Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"07a656a604f42f4d01ed433d","created_at":"2026-09-08T05:58:21.542Z","trace_propagation_headers":{"sentry-trace":"99827f46f7244ab19936b371f219c011-4ab8beabd38e4a7a","baggage":"sentry-trace_id=99827f46f7244ab19936b371f219c011,sentry-release=Unknown"},"correlation_id":"01M1ZSH2FXPNQBQ3FEMA9YHRV4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5324a94206c07c07044341c95aa6b42a42544039d9ebed216e32b65145f8c454","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:21.544Z","job_size_bytes":467,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-07a656a604f42f4d01ed433d: done: 0.453651 sec","job_status":"done","queue_duration_s":1.818141,"scheduling_latency_s":1.818156,"gitaly_calls":7,"gitaly_duration_s":0.045342,"redis_calls":33,"redis_duration_s":0.0033,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.00036,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000907,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.001432,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000601,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.391841,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.453651,"completed_at":"2026-09-08T05:58:23.815Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011194,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2085gitlab # [ 246.510504] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:23.819Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"e7546c32-5f37-463d-bf9f-3d653d48b120\"}"],"class":"WebHookWorker","jid":"109bc30e86d10d546ea39387","created_at":"2026-09-08T05:58:21.553Z","trace_propagation_headers":{"sentry-trace":"99827f46f7244ab19936b371f219c011-4ab8beabd38e4a7a","baggage":"sentry-trace_id=99827f46f7244ab19936b371f219c011,sentry-release=Unknown"},"correlation_id":"01M1ZSH2FXPNQBQ3FEMA9YHRV4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2738ea1e2b23ffa9af0d1ae5748072d1ec33f90d9a410d3f96220f35ef00ea7a","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:21.554Z","job_size_bytes":1749,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-109bc30e86d10d546ea39387: start","job_status":"start","queue_duration_s":2.264405,"scheduling_latency_s":2.264424}2086gitlab # [ 246.558978] gitaly[919]: time="2026-09-08T05:58:23.849Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSH7SQG80GJEGHRTCD93BY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:58:23.843" pid=919 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2087gitlab # [ 246.559531] gitlab-workhorse[834]: time="2026-09-08T05:58:23Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672088gitlab # [ 246.559951] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:58:23 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 502089gitlab # [ 246.560650] gitaly[919]: time="2026-09-08T05:58:23.850Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSH7SQG80GJEGHRTCD93BY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:58:23.843" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc2090gitlab # [ 246.561436] gitaly[919]: time="2026-09-08T05:58:23.850Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSH7SQG80GJEGHRTCD93BY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:58:23.843" grpc.time_ms=6.325 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc2091gitlab # [ 246.568112] gitaly[919]: time="2026-09-08T05:58:23.896Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSH7VBMKN7E85BPDRZ1GCG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:58:23.885" pid=919 remote_ip="2001:db8:1::1" request_sha=5ed75c65502e649bf285f014d38672643aec1a05 response_bytes=338 span.kind=server system=grpc2092gitlab # [ 246.610813] gitaly[919]: time="2026-09-08T05:58:23.896Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1189 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSH7VBMKN7E85BPDRZ1GCG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:58:23.885" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc2093gitlab # [ 246.611671] gitlab-workhorse[834]: time="2026-09-08T05:58:23Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3382094gitlab # [ 246.612168] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:58:23 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 338 "" "git/2.55.0" 452095gitlab # [ 246.612670] gitaly[919]: time="2026-09-08T05:58:23.896Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1189 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSH7VBMKN7E85BPDRZ1GCG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:58:23.885" grpc.time_ms=10.894 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc2096gitlab # [ 246.649163] nixbot[2652]: INFO: ::ffff:127.0.0.1:33376 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2097gitlab # [ 246.657959] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:23.985Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"e7546c32-5f37-463d-bf9f-3d653d48b120\"}"],"class":"WebHookWorker","jid":"109bc30e86d10d546ea39387","created_at":"2026-09-08T05:58:21.553Z","trace_propagation_headers":{"sentry-trace":"99827f46f7244ab19936b371f219c011-4ab8beabd38e4a7a","baggage":"sentry-trace_id=99827f46f7244ab19936b371f219c011,sentry-release=Unknown"},"correlation_id":"01M1ZSH2FXPNQBQ3FEMA9YHRV4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2738ea1e2b23ffa9af0d1ae5748072d1ec33f90d9a410d3f96220f35ef00ea7a","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:21.554Z","job_size_bytes":1749,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-109bc30e86d10d546ea39387: done: 0.166489 sec","job_status":"done","queue_duration_s":2.264405,"scheduling_latency_s":2.264424,"redis_calls":14,"redis_duration_s":0.001838,"redis_read_bytes":25,"redis_write_bytes":4682,"redis_queues_calls":2,"redis_queues_duration_s":0.000255,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3726,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001049,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000534,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.006336838999999372,"cpu_s":0.017368,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.166489,"completed_at":"2026-09-08T05:58:23.985Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00202,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2098gitlab # [ 246.663375] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:23.987Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"ecb0f031819b0def6f58cabc","created_at":"2026-09-08T05:58:21.678Z","trace_propagation_headers":{"sentry-trace":"7dfeaf199a324d26a27345c2f099034a-6d1baec0857b41ed","baggage":"sentry-trace_id=7dfeaf199a324d26a27345c2f099034a,sentry-release=Unknown"},"correlation_id":"01M1ZSFR36N5H00QAG8HS0GVC4","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:21.681Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-ecb0f031819b0def6f58cabc: start","job_status":"start","queue_duration_s":2.305288,"scheduling_latency_s":2.305308}2099gitlab # [ 246.700330] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:24.028Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"ecb0f031819b0def6f58cabc","created_at":"2026-09-08T05:58:21.678Z","trace_propagation_headers":{"sentry-trace":"7dfeaf199a324d26a27345c2f099034a-6d1baec0857b41ed","baggage":"sentry-trace_id=7dfeaf199a324d26a27345c2f099034a,sentry-release=Unknown"},"correlation_id":"01M1ZSFR36N5H00QAG8HS0GVC4","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:21.681Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-ecb0f031819b0def6f58cabc: done: 0.041195 sec","job_status":"done","queue_duration_s":2.305288,"scheduling_latency_s":2.305308,"redis_calls":19,"redis_duration_s":0.008838,"redis_read_bytes":21,"redis_write_bytes":4290,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00235,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.001184,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2261,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.003752,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001552,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02422,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.007760205,"duration_s":0.041195,"completed_at":"2026-09-08T05:58:24.028Z","load_balancing_strategy":"primary","db_duration_s":0.00623,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2100gitlab # [ 246.754450] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:24.035Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","1e7dbd969a6b5c5c332d3f37"],"class":"WebHooks::LogExecutionWorker","jid":"900380eb4ab354b77524a87e","created_at":"2026-09-08T05:58:22.806Z","trace_propagation_headers":{"sentry-trace":"7dfeaf199a324d26a27345c2f099034a-356e1607058245ad","baggage":"sentry-trace_id=7dfeaf199a324d26a27345c2f099034a,sentry-release=Unknown"},"correlation_id":"01M1ZSFR36N5H00QAG8HS0GVC4","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:adc0660df59f552a77d4c8f64f5b5c71d3274bd627213865ab27f259b7620da3","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:22.815Z","job_size_bytes":2593,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-900380eb4ab354b77524a87e: start","job_status":"start","queue_duration_s":1.220322,"scheduling_latency_s":1.220339}2101gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=900b61437f51ef58d953b2d67b98812ee58b53c9'2102gitlab # [ 246.769898] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:24.070Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","1e7dbd969a6b5c5c332d3f37"],"class":"WebHooks::LogExecutionWorker","jid":"900380eb4ab354b77524a87e","created_at":"2026-09-08T05:58:22.806Z","trace_propagation_headers":{"sentry-trace":"7dfeaf199a324d26a27345c2f099034a-356e1607058245ad","baggage":"sentry-trace_id=7dfeaf199a324d26a27345c2f099034a,sentry-release=Unknown"},"correlation_id":"01M1ZSFR36N5H00QAG8HS0GVC4","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:adc0660df59f552a77d4c8f64f5b5c71d3274bd627213865ab27f259b7620da3","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:22.815Z","job_size_bytes":2593,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-900380eb4ab354b77524a87e: done: 0.034596 sec","job_status":"done","queue_duration_s":1.220322,"scheduling_latency_s":1.220339,"redis_calls":10,"redis_duration_s":0.003932,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000236,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001827,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001869,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020503,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000279366,"duration_s":0.034596,"completed_at":"2026-09-08T05:58:24.070Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00608,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2103gitlab # [ 246.770752] nixbot[2652]: {"ts": "2026-09-08T05:58:24.068Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2104gitlab # [ 246.772119] gitaly[919]: time="2026-09-08T05:58:24.067Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=28 command.spawn_token_fork_ms=22 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSH7ZZ4EXDACGAZVZ2339V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:58:24.037" grpc.time_ms=30.035 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc2105gitlab # [ 246.784183] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:58:24 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 682106gitlab # [ 246.785925] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:24.074Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","109bc30e86d10d546ea39387"],"class":"WebHooks::LogExecutionWorker","jid":"bc97cb8d1c462babb84e06c8","created_at":"2026-09-08T05:58:23.979Z","trace_propagation_headers":{"sentry-trace":"99827f46f7244ab19936b371f219c011-c1211f5a9bb343a9","baggage":"sentry-trace_id=99827f46f7244ab19936b371f219c011,sentry-release=Unknown"},"correlation_id":"01M1ZSH2FXPNQBQ3FEMA9YHRV4","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d61275be78fa2d591e26ce552e11f6cb41b91ff5ae23747423fb1cf99e37ae8c","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:23.981Z","job_size_bytes":2590,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-bc97cb8d1c462babb84e06c8: start","job_status":"start","queue_duration_s":0.092702,"scheduling_latency_s":0.092717}2107gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=900b61437f51ef58d953b2d67b98812ee58b53c9', in 0.07 seconds)2108gitlab # [ 246.825299] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:24.107Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","109bc30e86d10d546ea39387"],"class":"WebHooks::LogExecutionWorker","jid":"bc97cb8d1c462babb84e06c8","created_at":"2026-09-08T05:58:23.979Z","trace_propagation_headers":{"sentry-trace":"99827f46f7244ab19936b371f219c011-c1211f5a9bb343a9","baggage":"sentry-trace_id=99827f46f7244ab19936b371f219c011,sentry-release=Unknown"},"correlation_id":"01M1ZSH2FXPNQBQ3FEMA9YHRV4","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d61275be78fa2d591e26ce552e11f6cb41b91ff5ae23747423fb1cf99e37ae8c","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:23.981Z","job_size_bytes":2590,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-bc97cb8d1c462babb84e06c8: done: 0.033566 sec","job_status":"done","queue_duration_s":0.092702,"scheduling_latency_s":0.092717,"redis_calls":7,"redis_duration_s":0.0065260000000000006,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005987,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000539,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015262,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033566,"completed_at":"2026-09-08T05:58:24.107Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00604,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2109gitlab # [ 246.866125] gitaly[919]: time="2026-09-08T05:58:24.117Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSH82DMVW59CJ4V3FCWX01 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T05:58:54.116" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:24.116" grpc.time_ms=0.568 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2110gitlab # [ 246.866764] nixbot[2652]: INFO: ::ffff:127.0.0.1:33392 - "GET /api/repos/gitlab/root/test-flake/builds?commit=900b61437f51ef58d953b2d67b98812ee58b53c9 HTTP/1.1" 200 OK2111gitlab # [ 246.867247] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:24.110Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"0059f97f24be42c4f55c0aba","created_at":"2026-09-08T05:58:24.015Z","trace_propagation_headers":{"sentry-trace":"7dfeaf199a324d26a27345c2f099034a-82dc93637feb4afb","baggage":"sentry-trace_id=7dfeaf199a324d26a27345c2f099034a,sentry-release=Unknown"},"correlation_id":"01M1ZSFR36N5H00QAG8HS0GVC4","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:24.021Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-0059f97f24be42c4f55c0aba: start","job_status":"start","queue_duration_s":0.089764,"scheduling_latency_s":0.089785}2112gitlab # [ 246.867809] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:24.175Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"0059f97f24be42c4f55c0aba","created_at":"2026-09-08T05:58:24.015Z","trace_propagation_headers":{"sentry-trace":"7dfeaf199a324d26a27345c2f099034a-82dc93637feb4afb","baggage":"sentry-trace_id=7dfeaf199a324d26a27345c2f099034a,sentry-release=Unknown"},"correlation_id":"01M1ZSFR36N5H00QAG8HS0GVC4","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:24.021Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-0059f97f24be42c4f55c0aba: done: 0.064398 sec","job_status":"done","queue_duration_s":0.089764,"scheduling_latency_s":0.089785,"redis_calls":11,"redis_duration_s":0.001643,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000254,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001019,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00037,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043117,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000201981,"duration_s":0.064398,"completed_at":"2026-09-08T05:58:24.175Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012799,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2113gitlab # [ 246.923232] gitaly[919]: time="2026-09-08T05:58:24.213Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSH826BAZQ6K21FKPDTXQ0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:58:24.201" pid=919 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2114gitlab # [ 246.923987] gitlab-workhorse[834]: time="2026-09-08T05:58:24Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672115gitlab # [ 246.924587] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:58:24 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1442116gitlab # [ 246.925421] gitaly[919]: time="2026-09-08T05:58:24.213Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSH826BAZQ6K21FKPDTXQ0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:58:24.201" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc2117gitlab # [ 246.930915] gitaly[919]: time="2026-09-08T05:58:24.214Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSH826BAZQ6K21FKPDTXQ0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:58:24.201" grpc.time_ms=12.048 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc2118gitlab # [ 246.979837] gitaly[919]: time="2026-09-08T05:58:24.286Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=29 command.spawn_token_fork_ms=21 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSH82DMVW59CJ4V3FCWX01 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T05:58:34.205" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:58:24.256" grpc.time_ms=29.948 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2119gitlab # [ 246.985084] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:24.312Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"24025ac68d02e210b5e4b0bb","created_at":"2026-09-08T05:58:24.306Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-d1a20dc8da7a4e71","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:24.310Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-24025ac68d02e210b5e4b0bb: start","job_status":"start","queue_duration_s":0.001994,"scheduling_latency_s":0.002026}2120gitlab # [ 246.996504] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:58:24 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/ce6b2a812361f5f303208def21eaf41c3c3740b0 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 2462121gitlab # [ 246.998409] nixbot[2652]: {"ts": "2026-09-08T05:58:24.326Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/ce6b2a812361f5f303208def21eaf41c3c3740b0 \"HTTP/1.1 201 Created\""}2122gitlab # [ 247.039526] gitaly[919]: time="2026-09-08T05:58:24.367Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSH8A9W9DZFNDD7QNZ8P16 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T05:58:54.166" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:24.367" grpc.time_ms=0.566 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2123gitlab # [ 247.070366] gitaly[919]: time="2026-09-08T05:58:24.398Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSH82DMVW59CJ4V3FCWX01 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T05:58:24.397" grpc.time_ms=0.329 pid=919 span.kind=server system=grpc2124gitlab # [ 247.082044] gitaly[919]: time="2026-09-08T05:58:24.409Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=6 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSH8A9W9DZFNDD7QNZ8P16 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T05:58:34.067" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:58:24.398" grpc.time_ms=11.487 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2125gitlab # [ 247.095635] gitaly[919]: time="2026-09-08T05:58:24.423Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=6 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSH8BDJ24KYQZJMZ9ZGN5M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:58:24.402" grpc.time_ms=21.396 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc2126gitlab # [ 247.096059] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:58:24 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 582127gitlab # [ 247.113832] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:58:24 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/ce6b2a812361f5f303208def21eaf41c3c3740b0 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1122128gitlab # [ 247.115061] nixbot[2652]: {"ts": "2026-09-08T05:58:24.443Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/ce6b2a812361f5f303208def21eaf41c3c3740b0 \"HTTP/1.1 201 Created\""}2129gitlab # [ 247.117963] gitaly[919]: time="2026-09-08T05:58:24.446Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSH82DMVW59CJ4V3FCWX01 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T05:58:24.445" grpc.time_ms=0.325 pid=919 span.kind=server system=grpc2130gitlab # [ 247.145708] gitaly[919]: time="2026-09-08T05:58:24.474Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSH82DMVW59CJ4V3FCWX01 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T05:58:24.472" grpc.time_ms=0.7 pid=919 span.kind=server system=grpc2131gitlab # [ 247.154568] gitaly[919]: time="2026-09-08T05:58:24.482Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSH8E112N07CGFP15Q0Q60 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T05:58:54.282" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:24.482" grpc.time_ms=0.465 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2132gitlab # [ 247.160262] gitaly[919]: time="2026-09-08T05:58:24.488Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSH8D9MB945PVW7V1HPQN7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:58:24.466" pid=919 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2133gitlab # [ 247.160905] gitaly[919]: time="2026-09-08T05:58:24.488Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1169 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSH8D9MB945PVW7V1HPQN7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:58:24.466" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc2134gitlab # [ 247.161452] gitaly[919]: time="2026-09-08T05:58:24.489Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1169 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSH8D9MB945PVW7V1HPQN7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:58:24.466" grpc.time_ms=22.347 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc2135gitlab # [ 247.162117] gitlab-workhorse[834]: time="2026-09-08T05:58:24Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162136gitlab # [ 247.162544] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:58:24 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 642137gitlab # [ 247.183270] gitaly[919]: time="2026-09-08T05:58:24.511Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSH8E112N07CGFP15Q0Q60 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T05:58:34.176" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:58:24.506" grpc.time_ms=5.276 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2138gitlab # [ 247.211262] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:58:24 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/ce6b2a812361f5f303208def21eaf41c3c3740b0 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 892139gitlab # [ 247.213224] nixbot[2652]: {"ts": "2026-09-08T05:58:24.541Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/ce6b2a812361f5f303208def21eaf41c3c3740b0 \"HTTP/1.1 201 Created\""}2140gitlab # [ 247.227646] gitaly[919]: time="2026-09-08T05:58:24.556Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSH82DMVW59CJ4V3FCWX01 diskcache=5ef37e06-f4d2-4c20-a320-4e33a6fdf2c8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-08T05:58:54.079" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:58:24.379" pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2141gitlab # [ 247.228077] gitaly[919]: time="2026-09-08T05:58:24.556Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=82 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7192 command.oublock=0 command.real_time_ms=169 command.spawn_token_fork_ms=0 command.system_time_ms=60 command.user_time_ms=22 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSH82DMVW59CJ4V3FCWX01 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-08T05:58:54.079" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:58:24.379" grpc.time_ms=176.466 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2142gitlab # [ 247.274872] gitaly[919]: time="2026-09-08T05:58:24.602Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSH82DMVW59CJ4V3FCWX01 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-08T05:58:54.201" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:24.601" grpc.time_ms=0.701 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2143gitlab # [ 247.293090] gitaly[919]: time="2026-09-08T05:58:24.621Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSH8HM9XCB34FCNJZ49PQ9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T05:58:54.420" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:24.620" grpc.time_ms=0.448 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2144gitlab # [ 247.298818] gitaly[919]: time="2026-09-08T05:58:24.627Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSH82DMVW59CJ4V3FCWX01 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T05:58:54.226" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:24.626" grpc.time_ms=0.409 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2145gitlab # [ 247.300786] gitaly[919]: time="2026-09-08T05:58:24.629Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSH8J9TS3KRCHS26XKXV4M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:58:24.619" grpc.time_ms=10.024 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc2146gitlab # [ 247.304306] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:58:24 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 472147gitlab # [ 247.305983] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:24.634Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"975cbe800ce29beebbd70c59","created_at":"2026-09-08T05:58:24.632Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-2b75a945f37b4333","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","duplicate-of":"24025ac68d02e210b5e4b0bb","job_size_bytes":3,"pid":2524,"job_status":"deduplicated","message":"PipelineProcessWorker JID-975cbe800ce29beebbd70c59: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2148gitlab # [ 247.307280] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:24.635Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"24025ac68d02e210b5e4b0bb","created_at":"2026-09-08T05:58:24.306Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-d1a20dc8da7a4e71","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:24.310Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2524,"job_status":"rescheduled","message":"PipelineProcessWorker JID-24025ac68d02e210b5e4b0bb: rescheduled"}2149gitlab # [ 247.316728] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:24.642Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"24025ac68d02e210b5e4b0bb","created_at":"2026-09-08T05:58:24.306Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-d1a20dc8da7a4e71","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:24.310Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-24025ac68d02e210b5e4b0bb: done: 0.330122 sec","job_status":"done","queue_duration_s":0.001994,"scheduling_latency_s":0.002026,"gitaly_calls":3,"gitaly_duration_s":0.192981,"redis_calls":69,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.0161,"redis_read_bytes":226,"redis_write_bytes":18465,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000844,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000843,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.002705,"redis_queues_read_bytes":24,"redis_queues_write_bytes":12311,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.007411,"redis_queues_metadata_read_bytes":110,"redis_queues_metadata_write_bytes":3546,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000354,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000715,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002384,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.091697,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.29617591,"duration_s":0.330122,"completed_at":"2026-09-08T05:58:24.642Z","load_balancing_strategy":"primary","db_duration_s":0.029016,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2150gitlab # [ 247.361631] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:24.645Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"7489f56d7ee22e54d3e38a9e","created_at":"2026-09-08T05:58:24.361Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-2b75a945f37b4333","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:24.363Z","job_size_bytes":23,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-7489f56d7ee22e54d3e38a9e: start","job_status":"start","queue_duration_s":0.281524,"scheduling_latency_s":0.281541}2151gitlab # [ 247.413167] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:24.680Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"7489f56d7ee22e54d3e38a9e","created_at":"2026-09-08T05:58:24.361Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-2b75a945f37b4333","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:24.363Z","job_size_bytes":23,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-7489f56d7ee22e54d3e38a9e: done: 0.034819 sec","job_status":"done","queue_duration_s":0.281524,"scheduling_latency_s":0.281541,"redis_calls":7,"redis_duration_s":0.002608,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002023,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000585,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021487,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034819,"completed_at":"2026-09-08T05:58:24.680Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005046,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2152gitlab # [ 247.414961] gitaly[919]: time="2026-09-08T05:58:24.659Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=648 command.oublock=0 command.real_time_ms=29 command.spawn_token_fork_ms=27 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSH8HM9XCB34FCNJZ49PQ9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-08T05:58:54.427" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:58:24.628" grpc.time_ms=30.902 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2153gitlab # [ 247.431052] gitlab-workhorse[834]: time="2026-09-08T05:58:24Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672154gitlab # [ 247.431676] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:58:24 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 812155gitlab # [ 247.432226] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:24.681Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"eda5bd6d32c96335f4121bc4","created_at":"2026-09-08T05:58:24.561Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-2b75a945f37b4333","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:24.563Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-eda5bd6d32c96335f4121bc4: start","job_status":"start","queue_duration_s":0.117213,"scheduling_latency_s":0.117232}2156gitlab # [ 247.447164] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:24.706Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"eda5bd6d32c96335f4121bc4","created_at":"2026-09-08T05:58:24.561Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-2b75a945f37b4333","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:24.563Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-eda5bd6d32c96335f4121bc4: done: 0.025599 sec","job_status":"done","queue_duration_s":0.117213,"scheduling_latency_s":0.117232,"redis_calls":7,"redis_duration_s":0.001464,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001014,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00045,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013626,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025599,"completed_at":"2026-09-08T05:58:24.706Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008047,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2157gitlab # [ 247.495095] gitaly[919]: time="2026-09-08T05:58:24.710Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSH8HM9XCB34FCNJZ49PQ9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T05:58:34.042" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:58:24.703" grpc.time_ms=7.68 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2158gitlab # [ 247.497205] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:24.707Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"143666abb9e184e95dec06cc","created_at":"2026-09-08T05:58:24.571Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-2b75a945f37b4333","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:24.573Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-143666abb9e184e95dec06cc: start","job_status":"start","queue_duration_s":0.134107,"scheduling_latency_s":0.134127}2159gitlab # [ 247.510672] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:24.751Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"143666abb9e184e95dec06cc","created_at":"2026-09-08T05:58:24.571Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-2b75a945f37b4333","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:24.573Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-143666abb9e184e95dec06cc: done: 0.043999 sec","job_status":"done","queue_duration_s":0.134107,"scheduling_latency_s":0.134127,"redis_calls":7,"redis_duration_s":0.025669,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.023172,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002497,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012161,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.043999,"completed_at":"2026-09-08T05:58:24.751Z","load_balancing_strategy":"primary","db_duration_s":0.004211,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2160gitlab # [ 247.578320] gitaly[919]: time="2026-09-08T05:58:24.714Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSH8KS28D2F0T1ENHX6H9W grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:58:24.703" pid=919 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2161gitlab # [ 247.578935] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:24.754Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"4eb8318a7e867460abb875ba","created_at":"2026-09-08T05:58:24.580Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-2b75a945f37b4333","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:24.581Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-4eb8318a7e867460abb875ba: start","job_status":"start","queue_duration_s":0.172475,"scheduling_latency_s":0.172494}2162gitlab # [ 247.579534] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:24.785Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"4eb8318a7e867460abb875ba","created_at":"2026-09-08T05:58:24.580Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-2b75a945f37b4333","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:24.581Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-4eb8318a7e867460abb875ba: done: 0.03119 sec","job_status":"done","queue_duration_s":0.172475,"scheduling_latency_s":0.172494,"redis_calls":10,"redis_duration_s":0.0027960000000000003,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002109,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00039,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000297,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014586,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03119,"completed_at":"2026-09-08T05:58:24.785Z","load_balancing_strategy":"primary","db_duration_s":0.010665,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2163gitlab # [ 247.630625] gitaly[919]: time="2026-09-08T05:58:24.714Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSH8KS28D2F0T1ENHX6H9W grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:58:24.703" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc2164gitlab # [ 247.631495] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:24.786Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"8ae8fbb65d9f6170036c55d9","created_at":"2026-09-08T05:58:24.581Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-2b75a945f37b4333","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:24.582Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-8ae8fbb65d9f6170036c55d9: start","job_status":"start","queue_duration_s":0.20332,"scheduling_latency_s":0.203336}2165gitlab # [ 247.675563] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:24.813Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"8ae8fbb65d9f6170036c55d9","created_at":"2026-09-08T05:58:24.581Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-2b75a945f37b4333","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:24.582Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-8ae8fbb65d9f6170036c55d9: done: 0.027047 sec","job_status":"done","queue_duration_s":0.20332,"scheduling_latency_s":0.203336,"redis_calls":7,"redis_duration_s":0.001443,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001195,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000248,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014741,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027047,"completed_at":"2026-09-08T05:58:24.813Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005923,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2166gitlab # [ 247.676635] gitaly[919]: time="2026-09-08T05:58:24.715Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSH8KS28D2F0T1ENHX6H9W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:58:24.703" grpc.time_ms=11.156 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc2167gitlab # [ 247.688498] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:24.815Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"6aaf3c3e00ae3aa3cf8dccd2","created_at":"2026-09-08T05:58:24.583Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-2b75a945f37b4333","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:24.585Z","job_size_bytes":19,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-6aaf3c3e00ae3aa3cf8dccd2: start","job_status":"start","queue_duration_s":0.230054,"scheduling_latency_s":0.230075}2168gitlab # [ 247.731702] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:24.833Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"6aaf3c3e00ae3aa3cf8dccd2","created_at":"2026-09-08T05:58:24.583Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-2b75a945f37b4333","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:24.585Z","job_size_bytes":19,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-6aaf3c3e00ae3aa3cf8dccd2: done: 0.018061 sec","job_status":"done","queue_duration_s":0.230054,"scheduling_latency_s":0.230075,"redis_calls":8,"redis_duration_s":0.001142,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000897,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000245,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009938,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018061,"completed_at":"2026-09-08T05:58:24.833Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002192,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2169gitlab # [ 247.771596] gitaly[919]: time="2026-09-08T05:58:24.738Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSH8HM9XCB34FCNJZ49PQ9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-08T05:58:34.077" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:58:24.737" grpc.time_ms=0.211 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2170gitlab # [ 247.772269] nixbot[2652]: {"ts": "2026-09-08T05:58:25.087Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/900b61437f51ef58d953b2d67b98812ee58b53c9 \"HTTP/1.1 201 Created\""}2171gitlab # [ 247.772712] nixbot[2652]: {"ts": "2026-09-08T05:58:25.098Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-900b61437f51-4"}2172gitlab # [ 247.773228] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:24.834Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"834f31d6d1e09d3f99c813fd","created_at":"2026-09-08T05:58:24.585Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-2b75a945f37b4333","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:24.588Z","job_size_bytes":66,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-834f31d6d1e09d3f99c813fd: start","job_status":"start","queue_duration_s":0.245402,"scheduling_latency_s":0.245417}2173gitlab # [ 247.773817] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:24.850Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"834f31d6d1e09d3f99c813fd","created_at":"2026-09-08T05:58:24.585Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-2b75a945f37b4333","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:24.588Z","job_size_bytes":66,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-834f31d6d1e09d3f99c813fd: done: 0.016139 sec","job_status":"done","queue_duration_s":0.245402,"scheduling_latency_s":0.245417,"redis_calls":7,"redis_duration_s":0.00099,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000719,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000271,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009584,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016139,"completed_at":"2026-09-08T05:58:24.850Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002742,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2174gitlab # [ 247.820298] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:58:25 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/900b61437f51ef58d953b2d67b98812ee58b53c9 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 5172175gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=900b61437f51ef58d953b2d67b98812ee58b53c9'2176gitlab # [ 247.820959] gitaly[919]: time="2026-09-08T05:58:24.769Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=7 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSH8HM9XCB34FCNJZ49PQ9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-08T05:58:34.095" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:58:24.755" grpc.time_ms=13.137 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2177gitlab # [ 247.824058] gitaly[919]: time="2026-09-08T05:58:24.810Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSH8HM9XCB34FCNJZ49PQ9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T05:58:24.809" grpc.time_ms=0.325 pid=919 span.kind=server system=grpc2178gitlab # [ 247.863726] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:24.851Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"79a2cb201e3872b46b218988","created_at":"2026-09-08T05:58:24.589Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-2b75a945f37b4333","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:24.590Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-79a2cb201e3872b46b218988: start","job_status":"start","queue_duration_s":0.26042,"scheduling_latency_s":0.260435}2179gitlab # [ 247.864501] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:24.868Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"79a2cb201e3872b46b218988","created_at":"2026-09-08T05:58:24.589Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-2b75a945f37b4333","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:24.590Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-79a2cb201e3872b46b218988: done: 0.016825 sec","job_status":"done","queue_duration_s":0.26042,"scheduling_latency_s":0.260435,"redis_calls":7,"redis_duration_s":0.0009209999999999999,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000647,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000274,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010245,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016825,"completed_at":"2026-09-08T05:58:24.868Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00365,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2180gitlab # [ 247.883558] gitaly[919]: time="2026-09-08T05:58:24.867Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSH8HM9XCB34FCNJZ49PQ9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T05:58:24.866" grpc.time_ms=0.438 pid=919 span.kind=server system=grpc2181gitlab # [ 247.891218] gitaly[919]: time="2026-09-08T05:58:24.875Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSH8HM9XCB34FCNJZ49PQ9 diskcache=c33de48c-9c49-4ff8-b72d-1d3590b4021e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-08T05:58:34.114" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:58:24.774" pid=919 ref=refs/keep-around/900b61437f51ef58d953b2d67b98812ee58b53c9 remote_ip="2001:db8:1::1" revision=900b61437f51ef58d953b2d67b98812ee58b53c9 span.kind=server system=grpc username=root2182gitlab # [ 247.900639] nixbot[2652]: {"ts": "2026-09-08T05:58:25.194Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-900b61437f51-4", "argv0": "bwrap"}2183gitlab # [ 247.902748] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:24.869Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"37d9e8c105500791dfda04ed","created_at":"2026-09-08T05:58:24.591Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-2b75a945f37b4333","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:24.592Z","job_size_bytes":6,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-37d9e8c105500791dfda04ed: start","job_status":"start","queue_duration_s":0.276951,"scheduling_latency_s":0.276964}2184gitlab # [ 247.916660] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:24.878Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"37d9e8c105500791dfda04ed","created_at":"2026-09-08T05:58:24.591Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-2b75a945f37b4333","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:24.592Z","job_size_bytes":6,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-37d9e8c105500791dfda04ed: done: 0.009066 sec","job_status":"done","queue_duration_s":0.276951,"scheduling_latency_s":0.276964,"redis_calls":7,"redis_duration_s":0.001149,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000715,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000434,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005546,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009066,"completed_at":"2026-09-08T05:58:24.878Z","load_balancing_strategy":"primary","db_duration_s":0.000288,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2185gitlab # [ 247.959708] gitaly[919]: time="2026-09-08T05:58:24.875Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=45 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5241 command.oublock=8 command.real_time_ms=94 command.spawn_token_fork_ms=4 command.system_time_ms=32 command.user_time_ms=13 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSH8HM9XCB34FCNJZ49PQ9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-08T05:58:34.114" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-08T05:58:24.774" grpc.time_ms=100.794 pid=919 ref=refs/keep-around/900b61437f51ef58d953b2d67b98812ee58b53c9 remote_ip="2001:db8:1::1" revision=900b61437f51ef58d953b2d67b98812ee58b53c9 span.kind=server system=grpc username=root2186gitlab # [ 248.000595] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:24.879Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"c82ec4da2ef6baad12add6c4","created_at":"2026-09-08T05:58:24.592Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-2b75a945f37b4333","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:24.593Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-c82ec4da2ef6baad12add6c4: start","job_status":"start","queue_duration_s":0.285444,"scheduling_latency_s":0.285458}2187gitlab # [ 248.001217] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:24.893Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"c82ec4da2ef6baad12add6c4","created_at":"2026-09-08T05:58:24.592Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-2b75a945f37b4333","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:24.593Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-c82ec4da2ef6baad12add6c4: done: 0.014019 sec","job_status":"done","queue_duration_s":0.285444,"scheduling_latency_s":0.285458,"redis_calls":7,"redis_duration_s":0.000908,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000665,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000243,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009293,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014019,"completed_at":"2026-09-08T05:58:24.893Z","load_balancing_strategy":"primary","db_duration_s":0.001889,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2188gitlab # [ 248.044145] gitaly[919]: time="2026-09-08T05:58:24.949Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSH8HM9XCB34FCNJZ49PQ9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T05:58:54.680" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:24.948" grpc.time_ms=0.542 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2189gitlab # [ 248.044793] gitaly[919]: time="2026-09-08T05:58:25.030Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSH82DMVW59CJ4V3FCWX01 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T05:58:25.029" grpc.time_ms=0.336 pid=919 span.kind=server system=grpc2190gitlab # [ 248.045425] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:24.893Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"6fbbb85e6d701360026e73f9","created_at":"2026-09-08T05:58:24.635Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-2b75a945f37b4333","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:24.637Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-6fbbb85e6d701360026e73f9: start","job_status":"start","queue_duration_s":0.256912,"scheduling_latency_s":0.256925}2191gitlab # [ 248.051138] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:25.252Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"6fbbb85e6d701360026e73f9","created_at":"2026-09-08T05:58:24.635Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-2b75a945f37b4333","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:24.637Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-6fbbb85e6d701360026e73f9: done: 0.358343 sec","job_status":"done","queue_duration_s":0.256912,"scheduling_latency_s":0.256925,"gitaly_calls":3,"gitaly_duration_s":0.235863,"redis_calls":63,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.020922,"redis_read_bytes":144,"redis_write_bytes":16720,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000331,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.011428,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":20,"redis_queues_duration_s":0.002237,"redis_queues_read_bytes":24,"redis_queues_write_bytes":11226,"redis_queues_metadata_calls":18,"redis_queues_metadata_duration_s":0.002765,"redis_queues_metadata_read_bytes":28,"redis_queues_metadata_write_bytes":2886,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000143,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001876,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001811,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.075386,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.336819624,"duration_s":0.358343,"completed_at":"2026-09-08T05:58:25.252Z","load_balancing_strategy":"primary","db_duration_s":0.02707,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2192gitlab # [ 248.096943] gitaly[919]: time="2026-09-08T05:58:25.110Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSH82DMVW59CJ4V3FCWX01 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T05:58:25.109" grpc.time_ms=0.408 pid=919 span.kind=server system=grpc2193gitlab # [ 248.140634] gitaly[919]: time="2026-09-08T05:58:25.131Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSH82DMVW59CJ4V3FCWX01 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T05:58:25.131" grpc.time_ms=0.26 pid=919 span.kind=server system=grpc2194gitlab # [ 248.141442] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:25.253Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"016533921ca86af1f9b57a03","created_at":"2026-09-08T05:58:24.929Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-4a2ce78ea10e46e6","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:24.930Z","job_size_bytes":23,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-016533921ca86af1f9b57a03: start","job_status":"start","queue_duration_s":0.322556,"scheduling_latency_s":0.322572}2195gitlab # [ 248.142123] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:25.279Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"016533921ca86af1f9b57a03","created_at":"2026-09-08T05:58:24.929Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-4a2ce78ea10e46e6","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:24.930Z","job_size_bytes":23,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-016533921ca86af1f9b57a03: done: 0.02636 sec","job_status":"done","queue_duration_s":0.322556,"scheduling_latency_s":0.322572,"redis_calls":7,"redis_duration_s":0.001003,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000666,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000337,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018258,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02636,"completed_at":"2026-09-08T05:58:25.279Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004987,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2196gitlab # [ 248.166693] gitaly[919]: time="2026-09-08T05:58:25.134Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSH82DMVW59CJ4V3FCWX01 forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-08T05:58:54.548" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:58:24.948" operations="[repack_refs]" pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2197gitlab # [ 248.175701] gitaly[919]: time="2026-09-08T05:58:25.136Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSH82DMVW59CJ4V3FCWX01 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-08T05:58:54.548" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:58:24.948" pid=919 remote_ip="2001:db8:1::1" repository_info="{false {6 704 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-09-08 05:57:27.947721407 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2198gitlab # [ 248.222376] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:25.281Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"b1b7843b1332d8d676cec884","created_at":"2026-09-08T05:58:25.033Z","trace_propagation_headers":{"sentry-trace":"368cd40a01d34c2983b838121b7ec916-cfcae2308457452f","baggage":"sentry-trace_id=368cd40a01d34c2983b838121b7ec916,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSH8HM9XCB34FCNJZ49PQ9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:25.036Z","job_size_bytes":65,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-b1b7843b1332d8d676cec884: start","job_status":"start","queue_duration_s":0.244794,"scheduling_latency_s":0.244829}2199gitlab # [ 248.222536] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:25.302Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"b1b7843b1332d8d676cec884","created_at":"2026-09-08T05:58:25.033Z","trace_propagation_headers":{"sentry-trace":"368cd40a01d34c2983b838121b7ec916-cfcae2308457452f","baggage":"sentry-trace_id=368cd40a01d34c2983b838121b7ec916,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSH8HM9XCB34FCNJZ49PQ9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:25.036Z","job_size_bytes":65,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-b1b7843b1332d8d676cec884: done: 0.021688 sec","job_status":"done","queue_duration_s":0.244794,"scheduling_latency_s":0.244829,"redis_calls":7,"redis_duration_s":0.0010249999999999999,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000735,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00029,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013333,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021688,"completed_at":"2026-09-08T05:58:25.302Z","load_balancing_strategy":"primary","db_duration_s":0.003306,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2200gitlab # [ 248.262611] gitaly[919]: time="2026-09-08T05:58:25.141Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSH82DMVW59CJ4V3FCWX01 diskcache=3420e70d-ed9a-4639-86e4-f728869f7858 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-08T05:58:54.548" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:58:24.948" pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2201gitlab # [ 248.263399] gitaly[919]: time="2026-09-08T05:58:25.141Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=72 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7808 command.oublock=0 command.real_time_ms=186 command.spawn_token_fork_ms=0 command.system_time_ms=46 command.user_time_ms=26 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSH82DMVW59CJ4V3FCWX01 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-08T05:58:54.548" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:58:24.948" grpc.time_ms=192.46 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2202gitlab # [ 248.264078] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:25.303Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"e24d34c23a9c7911f26deb19","created_at":"2026-09-08T05:58:25.038Z","trace_propagation_headers":{"sentry-trace":"368cd40a01d34c2983b838121b7ec916-cfcae2308457452f","baggage":"sentry-trace_id=368cd40a01d34c2983b838121b7ec916,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSH8HM9XCB34FCNJZ49PQ9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:25.040Z","job_size_bytes":65,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-e24d34c23a9c7911f26deb19: start","job_status":"start","queue_duration_s":0.263574,"scheduling_latency_s":0.263591}2203gitlab # [ 248.274540] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:25.336Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"e24d34c23a9c7911f26deb19","created_at":"2026-09-08T05:58:25.038Z","trace_propagation_headers":{"sentry-trace":"368cd40a01d34c2983b838121b7ec916-cfcae2308457452f","baggage":"sentry-trace_id=368cd40a01d34c2983b838121b7ec916,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSH8HM9XCB34FCNJZ49PQ9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:25.040Z","job_size_bytes":65,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-e24d34c23a9c7911f26deb19: done: 0.032419 sec","job_status":"done","queue_duration_s":0.263574,"scheduling_latency_s":0.263591,"redis_calls":10,"redis_duration_s":0.001307,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000713,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.000594,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020277,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032419,"completed_at":"2026-09-08T05:58:25.336Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008061,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2204gitlab # [ 248.321197] gitaly[919]: time="2026-09-08T05:58:25.159Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSH82DMVW59CJ4V3FCWX01 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-08T05:58:54.548" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:58:24.948" pid=919 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2205gitlab # [ 248.361513] gitaly[919]: time="2026-09-08T05:58:25.160Z" level=info msg="optimized repository" clean_stale_data_time=22.888663ms clean_work_trees_time="69.841µs" commit_graph_time="3.631µs" correlation_id=01M1ZSH82DMVW59CJ4V3FCWX01 gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="3.911µs" pid=919 prune_time="3.352µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="4.19µs" storage_name=default system=housekeeping total_time=23.076117ms2206gitlab # [ 248.362124] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:25.337Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"26f2dc8934efa8e9f2c5e887","created_at":"2026-09-08T05:58:25.071Z","trace_propagation_headers":{"sentry-trace":"368cd40a01d34c2983b838121b7ec916-cfcae2308457452f","baggage":"sentry-trace_id=368cd40a01d34c2983b838121b7ec916,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSH8HM9XCB34FCNJZ49PQ9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:25.073Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-26f2dc8934efa8e9f2c5e887: start","job_status":"start","queue_duration_s":0.263935,"scheduling_latency_s":0.26395}2207gitlab # [ 248.362760] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:25.415Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"26f2dc8934efa8e9f2c5e887","created_at":"2026-09-08T05:58:25.071Z","trace_propagation_headers":{"sentry-trace":"368cd40a01d34c2983b838121b7ec916-cfcae2308457452f","baggage":"sentry-trace_id=368cd40a01d34c2983b838121b7ec916,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSH8HM9XCB34FCNJZ49PQ9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:25.073Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-26f2dc8934efa8e9f2c5e887: done: 0.078831 sec","job_status":"done","queue_duration_s":0.263935,"scheduling_latency_s":0.26395,"gitaly_calls":2,"gitaly_duration_s":0.005356,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.00418,"redis_read_bytes":80,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000598,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.00072,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000279,"redis_queues_read_bytes":3,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000923,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000142,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000304,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000616,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.004,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.056341,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.060116859,"duration_s":0.078831,"completed_at":"2026-09-08T05:58:25.415Z","load_balancing_strategy":"primary","db_duration_s":0.016543,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2208gitlab # [ 248.405608] gitaly[919]: time="2026-09-08T05:58:25.160Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSH82DMVW59CJ4V3FCWX01 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-08T05:58:54.548" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:58:24.948" pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2209gitlab # [ 248.406375] gitaly[919]: time="2026-09-08T05:58:25.193Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=12 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=12 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSH82DMVW59CJ4V3FCWX01 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-08T05:58:55.079" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:25.180" grpc.time_ms=13.022 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2210gitlab # [ 248.407421] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:25.416Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"e9fa81b9951776cfeb6afe7d","created_at":"2026-09-08T05:58:25.146Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-4a2ce78ea10e46e6","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:25.148Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-e9fa81b9951776cfeb6afe7d: start","job_status":"start","queue_duration_s":0.268684,"scheduling_latency_s":0.268699}2211gitlab # [ 248.458606] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:25.433Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"e9fa81b9951776cfeb6afe7d","created_at":"2026-09-08T05:58:25.146Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-4a2ce78ea10e46e6","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:25.148Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-e9fa81b9951776cfeb6afe7d: done: 0.016451 sec","job_status":"done","queue_duration_s":0.268684,"scheduling_latency_s":0.268699,"redis_calls":7,"redis_duration_s":0.000913,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000645,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000268,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011122,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016451,"completed_at":"2026-09-08T05:58:25.433Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002537,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2212gitlab # [ 248.459891] gitaly[919]: time="2026-09-08T05:58:25.242Z" level=info msg="finished unary call with code OK" catfile.duration_ms=7 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=7 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSH82DMVW59CJ4V3FCWX01 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T05:58:55.134" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:25.234" grpc.time_ms=8.245 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2213gitlab # [ 248.470883] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:25.434Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"f55f076fa7b70a18456e4c6c","created_at":"2026-09-08T05:58:25.154Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-4a2ce78ea10e46e6","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:25.156Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-f55f076fa7b70a18456e4c6c: start","job_status":"start","queue_duration_s":0.277858,"scheduling_latency_s":0.277872}2214gitlab # [ 248.518992] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:25.450Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"f55f076fa7b70a18456e4c6c","created_at":"2026-09-08T05:58:25.154Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-4a2ce78ea10e46e6","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:25.156Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-f55f076fa7b70a18456e4c6c: done: 0.016067 sec","job_status":"done","queue_duration_s":0.277858,"scheduling_latency_s":0.277872,"redis_calls":7,"redis_duration_s":0.000902,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000632,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00027,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011163,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016067,"completed_at":"2026-09-08T05:58:25.450Z","load_balancing_strategy":"primary","db_duration_s":0.002604,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2215gitlab # [ 248.558629] gitaly[919]: time="2026-09-08T05:58:25.382Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSH8HM9XCB34FCNJZ49PQ9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-08T05:58:55.081" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:25.381" grpc.time_ms=0.607 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2216gitlab # [ 248.559529] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:25.451Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"ccd1cf882fbb5eb4a881e1ec","created_at":"2026-09-08T05:58:25.163Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-4a2ce78ea10e46e6","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:25.164Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-ccd1cf882fbb5eb4a881e1ec: start","job_status":"start","queue_duration_s":0.286971,"scheduling_latency_s":0.286985}2217gitlab # [ 248.560192] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:25.472Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"ccd1cf882fbb5eb4a881e1ec","created_at":"2026-09-08T05:58:25.163Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-4a2ce78ea10e46e6","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:25.164Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-ccd1cf882fbb5eb4a881e1ec: done: 0.021232 sec","job_status":"done","queue_duration_s":0.286971,"scheduling_latency_s":0.286985,"redis_calls":10,"redis_duration_s":0.001359,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000732,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000382,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000245,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015351,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021232,"completed_at":"2026-09-08T05:58:25.472Z","load_balancing_strategy":"primary","db_duration_s":0.002975,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2218gitlab # [ 248.619802] gitaly[919]: time="2026-09-08T05:58:25.407Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSH8HM9XCB34FCNJZ49PQ9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T05:58:55.006" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:25.407" grpc.time_ms=0.512 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2219gitlab # [ 248.620598] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:25.473Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"85fc2cbaec5141f2247cb995","created_at":"2026-09-08T05:58:25.164Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-4a2ce78ea10e46e6","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:25.165Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-85fc2cbaec5141f2247cb995: start","job_status":"start","queue_duration_s":0.307997,"scheduling_latency_s":0.308017}2220gitlab # [ 248.621202] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:25.489Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"85fc2cbaec5141f2247cb995","created_at":"2026-09-08T05:58:25.164Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-4a2ce78ea10e46e6","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:25.165Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-85fc2cbaec5141f2247cb995: done: 0.016597 sec","job_status":"done","queue_duration_s":0.307997,"scheduling_latency_s":0.308017,"redis_calls":7,"redis_duration_s":0.000871,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000646,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000225,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010564,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016597,"completed_at":"2026-09-08T05:58:25.489Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002913,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2221gitlab # [ 248.670162] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:25.490Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"5adb9aad4421a33e0360894a","created_at":"2026-09-08T05:58:25.165Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-4a2ce78ea10e46e6","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:25.167Z","job_size_bytes":19,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-5adb9aad4421a33e0360894a: start","job_status":"start","queue_duration_s":0.323837,"scheduling_latency_s":0.323851}2222gitlab # [ 248.670818] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:25.504Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"5adb9aad4421a33e0360894a","created_at":"2026-09-08T05:58:25.165Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-4a2ce78ea10e46e6","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:25.167Z","job_size_bytes":19,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-5adb9aad4421a33e0360894a: done: 0.013955 sec","job_status":"done","queue_duration_s":0.323837,"scheduling_latency_s":0.323851,"redis_calls":8,"redis_duration_s":0.001029,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000802,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000227,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009107,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013955,"completed_at":"2026-09-08T05:58:25.504Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00205,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2223gitlab # [ 248.701590] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:25.505Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"63b38e854e3ab91f6e5ecf36","created_at":"2026-09-08T05:58:25.168Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-4a2ce78ea10e46e6","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:25.169Z","job_size_bytes":66,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-63b38e854e3ab91f6e5ecf36: start","job_status":"start","queue_duration_s":0.336769,"scheduling_latency_s":0.336783}2224gitlab # [ 248.716884] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:25.520Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"63b38e854e3ab91f6e5ecf36","created_at":"2026-09-08T05:58:25.168Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-4a2ce78ea10e46e6","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:25.169Z","job_size_bytes":66,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-63b38e854e3ab91f6e5ecf36: done: 0.014806 sec","job_status":"done","queue_duration_s":0.336769,"scheduling_latency_s":0.336783,"redis_calls":7,"redis_duration_s":0.000845,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000616,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000229,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010115,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014806,"completed_at":"2026-09-08T05:58:25.520Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001434,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2225gitlab # [ 248.758743] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:25.521Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"6dbfec19863e003cde68ac7c","created_at":"2026-09-08T05:58:25.169Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-4a2ce78ea10e46e6","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:25.170Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-6dbfec19863e003cde68ac7c: start","job_status":"start","queue_duration_s":0.351182,"scheduling_latency_s":0.351196}2226gitlab # [ 248.771589] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:25.537Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"6dbfec19863e003cde68ac7c","created_at":"2026-09-08T05:58:25.169Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-4a2ce78ea10e46e6","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:25.170Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-6dbfec19863e003cde68ac7c: done: 0.015817 sec","job_status":"done","queue_duration_s":0.351182,"scheduling_latency_s":0.351196,"redis_calls":7,"redis_duration_s":0.001058,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000822,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000236,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009496,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015817,"completed_at":"2026-09-08T05:58:25.537Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003269,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2227gitlab # [ 248.809792] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:25.538Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"0ddc6c03aad14bf3b69f806e","created_at":"2026-09-08T05:58:25.170Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-4a2ce78ea10e46e6","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:25.171Z","job_size_bytes":6,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-0ddc6c03aad14bf3b69f806e: start","job_status":"start","queue_duration_s":0.366728,"scheduling_latency_s":0.366742}2228gitlab # [ 248.823844] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:25.546Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"0ddc6c03aad14bf3b69f806e","created_at":"2026-09-08T05:58:25.170Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-4a2ce78ea10e46e6","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:25.171Z","job_size_bytes":6,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-0ddc6c03aad14bf3b69f806e: done: 0.008179 sec","job_status":"done","queue_duration_s":0.366728,"scheduling_latency_s":0.366742,"redis_calls":7,"redis_duration_s":0.0008519999999999999,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000618,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000234,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005198,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008179,"completed_at":"2026-09-08T05:58:25.546Z","load_balancing_strategy":"primary","db_duration_s":0.000235,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2229gitlab # [ 248.867081] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:25.547Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"bed1c8a6c3d70f5555fd3dd7","created_at":"2026-09-08T05:58:25.171Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-4a2ce78ea10e46e6","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:25.172Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-bed1c8a6c3d70f5555fd3dd7: start","job_status":"start","queue_duration_s":0.374559,"scheduling_latency_s":0.374572}2230gitlab # [ 248.873716] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:25.560Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"bed1c8a6c3d70f5555fd3dd7","created_at":"2026-09-08T05:58:25.171Z","trace_propagation_headers":{"sentry-trace":"4e49f634a1bf4eb79f8284b3cd72ea09-4a2ce78ea10e46e6","baggage":"sentry-trace_id=4e49f634a1bf4eb79f8284b3cd72ea09,sentry-release=Unknown"},"correlation_id":"01M1ZSH82DMVW59CJ4V3FCWX01","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:25.172Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-bed1c8a6c3d70f5555fd3dd7: done: 0.012985 sec","job_status":"done","queue_duration_s":0.374559,"scheduling_latency_s":0.374572,"redis_calls":7,"redis_duration_s":0.000913,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000681,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000232,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008661,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012985,"completed_at":"2026-09-08T05:58:25.560Z","load_balancing_strategy":"primary","db_duration_s":0.001811,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2231gitlab # [ 248.919717] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:25.561Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"a4665e5d92768361ddffa790","created_at":"2026-09-08T05:58:25.371Z","trace_propagation_headers":{"sentry-trace":"368cd40a01d34c2983b838121b7ec916-15e4256cba5b4a5d","baggage":"sentry-trace_id=368cd40a01d34c2983b838121b7ec916,sentry-release=Unknown"},"correlation_id":"01M1ZSH8HM9XCB34FCNJZ49PQ9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:25.372Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-a4665e5d92768361ddffa790: start","job_status":"start","queue_duration_s":0.18872,"scheduling_latency_s":0.188733}2232gitlab # [ 248.959882] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:25.579Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"a4665e5d92768361ddffa790","created_at":"2026-09-08T05:58:25.371Z","trace_propagation_headers":{"sentry-trace":"368cd40a01d34c2983b838121b7ec916-15e4256cba5b4a5d","baggage":"sentry-trace_id=368cd40a01d34c2983b838121b7ec916,sentry-release=Unknown"},"correlation_id":"01M1ZSH8HM9XCB34FCNJZ49PQ9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:25.372Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-a4665e5d92768361ddffa790: done: 0.018621 sec","job_status":"done","queue_duration_s":0.18872,"scheduling_latency_s":0.188733,"redis_calls":7,"redis_duration_s":0.000925,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000657,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000268,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013683,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018621,"completed_at":"2026-09-08T05:58:25.579Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00252,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2233gitlab # [ 249.009847] nixbot[2652]: INFO: ::ffff:127.0.0.1:33400 - "GET /api/repos/gitlab/root/test-flake/builds?commit=900b61437f51ef58d953b2d67b98812ee58b53c9 HTTP/1.1" 200 OK2234gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=900b61437f51ef58d953b2d67b98812ee58b53c9', in 1.18 seconds)2235(finished: subtest: push delivers the webhook, in 47.50 seconds)2236subtest: eval and build post commit statuses2237gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/900b61437f51ef58d953b2d67b98812ee58b53c9/statuses2238gitlab # [ 249.053172] nix-daemon[2811]: accepted connection from pid 3645, user nixbot2239gitlab # [ 249.088510] gitaly[919]: time="2026-09-08T05:58:26.416Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSHAAD26MJPMCSYSW9B790 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T05:58:56.215" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:26.415" grpc.time_ms=0.705 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2240gitlab # [ 249.113173] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:58:26 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/900b61437f51ef58d953b2d67b98812ee58b53c9/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 582241gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/900b61437f51ef58d953b2d67b98812ee58b53c9/statuses, in 0.08 seconds)2242gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/900b61437f51ef58d953b2d67b98812ee58b53c9/statuses2243gitlab # [ 250.202452] gitaly[919]: time="2026-09-08T05:58:27.530Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSHBCV2KB0DKQ78GY310FX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T05:58:57.328" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:27.529" grpc.time_ms=0.641 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2244gitlab # [ 250.230082] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:58:27 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/900b61437f51ef58d953b2d67b98812ee58b53c9/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 742245gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/900b61437f51ef58d953b2d67b98812ee58b53c9/statuses, in 0.12 seconds)2246gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/900b61437f51ef58d953b2d67b98812ee58b53c9/statuses2247gitlab # [ 251.329375] gitaly[919]: time="2026-09-08T05:58:28.657Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSHCFHESYA8942QEW8GHNX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T05:58:58.455" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:28.656" grpc.time_ms=0.873 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2248gitlab # [ 251.385752] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:58:28 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/900b61437f51ef58d953b2d67b98812ee58b53c9/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1192249gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/900b61437f51ef58d953b2d67b98812ee58b53c9/statuses, in 0.16 seconds)2250gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/900b61437f51ef58d953b2d67b98812ee58b53c9/statuses2251gitlab # [ 252.515848] gitaly[919]: time="2026-09-08T05:58:29.843Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSHDKVYE5M9TS8G4BNF9TT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T05:58:59.641" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:29.842" grpc.time_ms=0.929 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2252gitlab # [ 252.565457] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:58:29 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/900b61437f51ef58d953b2d67b98812ee58b53c9/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1372253gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/900b61437f51ef58d953b2d67b98812ee58b53c9/statuses, in 0.18 seconds)2254gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/900b61437f51ef58d953b2d67b98812ee58b53c9/statuses2255gitlab # [ 253.667766] gitaly[919]: time="2026-09-08T05:58:30.994Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSHERQ3N42BRF9CF3MXMZR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T05:59:00.792" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:30.993" grpc.time_ms=1.236 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2256gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/900b61437f51ef58d953b2d67b98812ee58b53c9/statuses, in 0.12 seconds)2257gitlab # [ 253.695551] nix-daemon[2811]: accepted connection from pid 3687, user nixbot2258gitlab # [ 253.698506] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:58:31 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/900b61437f51ef58d953b2d67b98812ee58b53c9/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 832259gitlab # [ 253.704546] nix-daemon[2811]: accepted connection from pid 3645, user nixbot2260gitlab # [ 253.784472] gitaly[919]: time="2026-09-08T05:58:31.112Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSHEWR0QVE0453WXSE6YR9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T05:59:01.010" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:31.111" grpc.time_ms=1.008 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2261gitlab # [ 253.820140] gitaly[919]: time="2026-09-08T05:58:31.148Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSHEWR0QVE0453WXSE6YR9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T05:58:41.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:58:31.138" grpc.time_ms=9.284 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2262gitlab # [ 253.846297] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:31.165Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"db3378d584e05ff04569f2ba","created_at":"2026-09-08T05:58:31.151Z","trace_propagation_headers":{"sentry-trace":"488cf9110d2f42e6a6d0393779bf473e-ba99f7842b1c4be1","baggage":"sentry-trace_id=488cf9110d2f42e6a6d0393779bf473e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"51534324f14b712b45a8ab067a8709c3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:31.163Z","job_size_bytes":2,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-db3378d584e05ff04569f2ba: start","job_status":"start","queue_duration_s":0.002127,"scheduling_latency_s":0.002162}2263gitlab # [ 253.865563] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:58:31 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/900b61437f51ef58d953b2d67b98812ee58b53c9 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 1282264gitlab # [ 253.866845] nixbot[2652]: {"ts": "2026-09-08T05:58:31.194Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/900b61437f51ef58d953b2d67b98812ee58b53c9 \"HTTP/1.1 201 Created\""}2265gitlab # [ 253.876668] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:31.204Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}2266gitlab # [ 253.888579] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:31.216Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"db3378d584e05ff04569f2ba","created_at":"2026-09-08T05:58:31.151Z","trace_propagation_headers":{"sentry-trace":"488cf9110d2f42e6a6d0393779bf473e-ba99f7842b1c4be1","baggage":"sentry-trace_id=488cf9110d2f42e6a6d0393779bf473e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"51534324f14b712b45a8ab067a8709c3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:31.163Z","job_size_bytes":2,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-db3378d584e05ff04569f2ba: done: 0.051086 sec","job_status":"done","queue_duration_s":0.002127,"scheduling_latency_s":0.002162,"redis_calls":9,"redis_duration_s":0.004779,"redis_read_bytes":7,"redis_write_bytes":1112,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001018,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002429,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001332,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010217,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.051086,"completed_at":"2026-09-08T05:58:31.216Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000953,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2267gitlab # [ 253.908976] gitaly[919]: time="2026-09-08T05:58:31.232Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSHF0XSE08AQRDR8TH7JDE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T05:59:01.130" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:31.231" grpc.time_ms=0.785 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2268gitlab # [ 253.910743] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:31.238Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"3ef033e14f0439d0d35a3a79","created_at":"2026-09-08T05:58:31.178Z","trace_propagation_headers":{"sentry-trace":"0eec2435558a4dcc9097c442d12e2e30-f99649905bf546c0","baggage":"sentry-trace_id=0eec2435558a4dcc9097c442d12e2e30,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSHEWR0QVE0453WXSE6YR9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:31.182Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-3ef033e14f0439d0d35a3a79: start","job_status":"start","queue_duration_s":0.056047,"scheduling_latency_s":0.056074}2269gitlab # [ 253.976190] gitaly[919]: time="2026-09-08T05:58:31.304Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=620 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSHF0XSE08AQRDR8TH7JDE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T05:58:41.058" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:58:31.298" grpc.time_ms=5.575 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2270gitlab # [ 254.019303] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:58:31 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/900b61437f51ef58d953b2d67b98812ee58b53c9 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1492271gitlab # [ 254.021668] nixbot[2652]: {"ts": "2026-09-08T05:58:31.349Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/900b61437f51ef58d953b2d67b98812ee58b53c9 \"HTTP/1.1 201 Created\""}2272gitlab # [ 254.042084] gitaly[919]: time="2026-09-08T05:58:31.370Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSHEWR0QVE0453WXSE6YR9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T05:58:31.369" grpc.time_ms=0.281 pid=919 span.kind=server system=grpc2273gitlab # [ 254.067948] gitaly[919]: time="2026-09-08T05:58:31.394Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSHF608QH3KEV24ZFR8DKK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T05:59:01.293" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:31.393" grpc.time_ms=0.698 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2274gitlab # [ 254.071274] gitaly[919]: time="2026-09-08T05:58:31.396Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSHEWR0QVE0453WXSE6YR9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T05:58:31.396" grpc.time_ms=0.278 pid=919 span.kind=server system=grpc2275gitlab # [ 254.096112] gitaly[919]: time="2026-09-08T05:58:31.424Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSHF608QH3KEV24ZFR8DKK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-08T05:58:41.085" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:58:31.416" grpc.time_ms=8.045 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2276gitlab # [ 254.107755] gitaly[919]: time="2026-09-08T05:58:31.436Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1ZSHEWR0QVE0453WXSE6YR9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-08T05:58:31.435" grpc.time_ms=0.297 pid=919 span.kind=server system=grpc2277gitlab # [ 254.124034] gitaly[919]: time="2026-09-08T05:58:31.452Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSHEWR0QVE0453WXSE6YR9 diskcache=db048d65-22a8-4292-a0b2-cad1d43745b9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-08T05:59:01.046" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:58:31.347" pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2278gitlab # [ 254.132691] gitaly[919]: time="2026-09-08T05:58:31.461Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=84 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7114 command.oublock=0 command.real_time_ms=93 command.spawn_token_fork_ms=0 command.system_time_ms=55 command.user_time_ms=29 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSHEWR0QVE0453WXSE6YR9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-08T05:59:01.046" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-08T05:58:31.347" grpc.time_ms=105.337 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2279gitlab # [ 254.147059] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:58:31 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/900b61437f51ef58d953b2d67b98812ee58b53c9 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1142280gitlab # [ 254.150408] nixbot[2652]: {"ts": "2026-09-08T05:58:31.478Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/900b61437f51ef58d953b2d67b98812ee58b53c9 \"HTTP/1.1 201 Created\""}2281gitlab # [ 254.230515] gitaly[919]: time="2026-09-08T05:58:31.558Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSHEWR0QVE0453WXSE6YR9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-08T05:59:01.157" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:31.558" grpc.time_ms=0.657 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2282gitlab # [ 254.250984] gitaly[919]: time="2026-09-08T05:58:31.579Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSHEWR0QVE0453WXSE6YR9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T05:59:01.178" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:31.578" grpc.time_ms=0.478 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2283gitlab # [ 254.262270] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:31.585Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"c9d9f53938f804fb1d18421a","created_at":"2026-09-08T05:58:31.583Z","trace_propagation_headers":{"sentry-trace":"0eec2435558a4dcc9097c442d12e2e30-fe6f39b6aba34d32","baggage":"sentry-trace_id=0eec2435558a4dcc9097c442d12e2e30,sentry-release=Unknown"},"correlation_id":"01M1ZSHEWR0QVE0453WXSE6YR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"3ef033e14f0439d0d35a3a79","job_size_bytes":3,"pid":2524,"job_status":"deduplicated","message":"PipelineProcessWorker JID-c9d9f53938f804fb1d18421a: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2284gitlab # [ 254.262613] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:31.586Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"3ef033e14f0439d0d35a3a79","created_at":"2026-09-08T05:58:31.178Z","trace_propagation_headers":{"sentry-trace":"0eec2435558a4dcc9097c442d12e2e30-f99649905bf546c0","baggage":"sentry-trace_id=0eec2435558a4dcc9097c442d12e2e30,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSHEWR0QVE0453WXSE6YR9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:31.182Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2524,"job_status":"rescheduled","message":"PipelineProcessWorker JID-3ef033e14f0439d0d35a3a79: rescheduled"}2285gitlab # [ 254.264659] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:31.592Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"3ef033e14f0439d0d35a3a79","created_at":"2026-09-08T05:58:31.178Z","trace_propagation_headers":{"sentry-trace":"0eec2435558a4dcc9097c442d12e2e30-f99649905bf546c0","baggage":"sentry-trace_id=0eec2435558a4dcc9097c442d12e2e30,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1ZSHEWR0QVE0453WXSE6YR9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:31.182Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-3ef033e14f0439d0d35a3a79: done: 0.353915 sec","job_status":"done","queue_duration_s":0.056047,"scheduling_latency_s":0.056074,"gitaly_calls":3,"gitaly_duration_s":0.150905,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.03157,"redis_read_bytes":248,"redis_write_bytes":21785,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002967,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001128,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.004929,"redis_queues_read_bytes":37,"redis_queues_write_bytes":14470,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.011906,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.001771,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.002132,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.00377,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.053,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.013,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.019,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.031,"db_ci_duration_s":0.022,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.100207,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.295367707,"duration_s":0.353915,"completed_at":"2026-09-08T05:58:31.592Z","load_balancing_strategy":"primary","db_duration_s":0.063418,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2286gitlab # [ 254.334052] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:31.593Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"26244f6cf3d70737cb8a9d7f","created_at":"2026-09-08T05:58:31.192Z","trace_propagation_headers":{"sentry-trace":"488cf9110d2f42e6a6d0393779bf473e-ba99f7842b1c4be1","baggage":"sentry-trace_id=488cf9110d2f42e6a6d0393779bf473e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ed17d0c9d48ebc34c691c0c854ef71bd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:31.202Z","job_size_bytes":2,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-26244f6cf3d70737cb8a9d7f: start","job_status":"start","queue_duration_s":0.391305,"scheduling_latency_s":0.391326}2287gitlab # [ 254.334735] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:31.616Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"26244f6cf3d70737cb8a9d7f","created_at":"2026-09-08T05:58:31.192Z","trace_propagation_headers":{"sentry-trace":"488cf9110d2f42e6a6d0393779bf473e-ba99f7842b1c4be1","baggage":"sentry-trace_id=488cf9110d2f42e6a6d0393779bf473e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ed17d0c9d48ebc34c691c0c854ef71bd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:31.202Z","job_size_bytes":2,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-26244f6cf3d70737cb8a9d7f: done: 0.022814 sec","job_status":"done","queue_duration_s":0.391305,"scheduling_latency_s":0.391326,"redis_calls":18,"redis_duration_s":0.0020800000000000003,"redis_read_bytes":20,"redis_write_bytes":4694,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000508,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000153,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3011,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001059,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00036,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015187,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022814,"completed_at":"2026-09-08T05:58:31.616Z","load_balancing_strategy":"primary","db_duration_s":0.001536,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2288gitlab # [ 254.376434] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:31.617Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"ef8f6822998385d6a60be953","created_at":"2026-09-08T05:58:31.207Z","trace_propagation_headers":{"sentry-trace":"488cf9110d2f42e6a6d0393779bf473e-ba99f7842b1c4be1","baggage":"sentry-trace_id=488cf9110d2f42e6a6d0393779bf473e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"248336a2693d5c3f96715d773be9fce3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:31.237Z","job_size_bytes":2,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-ef8f6822998385d6a60be953: start","job_status":"start","queue_duration_s":0.380256,"scheduling_latency_s":0.380271}2289gitlab # [ 254.377357] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:31.633Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"ef8f6822998385d6a60be953","created_at":"2026-09-08T05:58:31.207Z","trace_propagation_headers":{"sentry-trace":"488cf9110d2f42e6a6d0393779bf473e-ba99f7842b1c4be1","baggage":"sentry-trace_id=488cf9110d2f42e6a6d0393779bf473e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"248336a2693d5c3f96715d773be9fce3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:31.237Z","job_size_bytes":2,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-ef8f6822998385d6a60be953: done: 0.016444 sec","job_status":"done","queue_duration_s":0.380256,"scheduling_latency_s":0.380271,"redis_calls":11,"redis_duration_s":0.0016740000000000001,"redis_read_bytes":9,"redis_write_bytes":1459,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00071,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000709,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000255,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010726,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016444,"completed_at":"2026-09-08T05:58:31.633Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000622,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2290gitlab # [ 254.434764] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:31.635Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"97f1b56be4c0149aa328b4ff","created_at":"2026-09-08T05:58:31.242Z","trace_propagation_headers":{"sentry-trace":"488cf9110d2f42e6a6d0393779bf473e-ba99f7842b1c4be1","baggage":"sentry-trace_id=488cf9110d2f42e6a6d0393779bf473e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2b6e1b5d64d5957954376ec392cba2b6","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:31.249Z","job_size_bytes":2,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-97f1b56be4c0149aa328b4ff: start","job_status":"start","queue_duration_s":0.385949,"scheduling_latency_s":0.385968}2291gitlab # [ 254.435675] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:31.653Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"97f1b56be4c0149aa328b4ff","created_at":"2026-09-08T05:58:31.242Z","trace_propagation_headers":{"sentry-trace":"488cf9110d2f42e6a6d0393779bf473e-ba99f7842b1c4be1","baggage":"sentry-trace_id=488cf9110d2f42e6a6d0393779bf473e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2b6e1b5d64d5957954376ec392cba2b6","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:31.249Z","job_size_bytes":2,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-97f1b56be4c0149aa328b4ff: done: 0.018643 sec","job_status":"done","queue_duration_s":0.385949,"scheduling_latency_s":0.385968,"redis_calls":12,"redis_duration_s":0.0016250000000000001,"redis_read_bytes":10,"redis_write_bytes":1576,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000268,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000799,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000558,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011546,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.005437004,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.018643,"completed_at":"2026-09-08T05:58:31.653Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001585,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2292gitlab # [ 254.449797] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:31.654Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"421d7fbc018376adb8c9b873","created_at":"2026-09-08T05:58:31.257Z","trace_propagation_headers":{"sentry-trace":"488cf9110d2f42e6a6d0393779bf473e-ba99f7842b1c4be1","baggage":"sentry-trace_id=488cf9110d2f42e6a6d0393779bf473e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4b18da1863d890b655900abe3c81373d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:31.263Z","job_size_bytes":2,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-421d7fbc018376adb8c9b873: start","job_status":"start","queue_duration_s":0.391382,"scheduling_latency_s":0.391395}2293gitlab # [ 254.463050] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:31.661Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}2294gitlab # [ 254.466027] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:31.665Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"421d7fbc018376adb8c9b873","created_at":"2026-09-08T05:58:31.257Z","trace_propagation_headers":{"sentry-trace":"488cf9110d2f42e6a6d0393779bf473e-ba99f7842b1c4be1","baggage":"sentry-trace_id=488cf9110d2f42e6a6d0393779bf473e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4b18da1863d890b655900abe3c81373d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:31.263Z","job_size_bytes":2,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-421d7fbc018376adb8c9b873: done: 0.011065 sec","job_status":"done","queue_duration_s":0.391382,"scheduling_latency_s":0.391395,"redis_calls":9,"redis_duration_s":0.00112,"redis_read_bytes":7,"redis_write_bytes":1185,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000242,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000642,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000236,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006353,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011065,"completed_at":"2026-09-08T05:58:31.665Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000241,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2295gitlab # [ 254.530670] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:31.666Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"726d88f5c2a0a9aafbcac1a5","created_at":"2026-09-08T05:58:31.269Z","trace_propagation_headers":{"sentry-trace":"488cf9110d2f42e6a6d0393779bf473e-ba99f7842b1c4be1","baggage":"sentry-trace_id=488cf9110d2f42e6a6d0393779bf473e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a8ec3d9c6d8cc1c2379051955a214648","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:31.271Z","job_size_bytes":2,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-726d88f5c2a0a9aafbcac1a5: start","job_status":"start","queue_duration_s":0.394409,"scheduling_latency_s":0.394422}2296gitlab # [ 254.531472] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:31.681Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"726d88f5c2a0a9aafbcac1a5","created_at":"2026-09-08T05:58:31.269Z","trace_propagation_headers":{"sentry-trace":"488cf9110d2f42e6a6d0393779bf473e-ba99f7842b1c4be1","baggage":"sentry-trace_id=488cf9110d2f42e6a6d0393779bf473e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a8ec3d9c6d8cc1c2379051955a214648","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:31.271Z","job_size_bytes":2,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-726d88f5c2a0a9aafbcac1a5: done: 0.014818 sec","job_status":"done","queue_duration_s":0.394409,"scheduling_latency_s":0.394422,"redis_calls":11,"redis_duration_s":0.001515,"redis_read_bytes":9,"redis_write_bytes":1399,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000284,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000664,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000567,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008861,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000291657,"exclusive_lock_hold_duration_s":0.00401755,"duration_s":0.014818,"completed_at":"2026-09-08T05:58:31.681Z","load_balancing_strategy":"primary","db_duration_s":0.001764,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2297gitlab # [ 254.586583] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:31.682Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"59597b0bc3e70e188e20577a","created_at":"2026-09-08T05:58:31.274Z","trace_propagation_headers":{"sentry-trace":"488cf9110d2f42e6a6d0393779bf473e-ba99f7842b1c4be1","baggage":"sentry-trace_id=488cf9110d2f42e6a6d0393779bf473e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"764fe936c1e93d860372464e05a29c8c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:31.276Z","job_size_bytes":2,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-59597b0bc3e70e188e20577a: start","job_status":"start","queue_duration_s":0.405543,"scheduling_latency_s":0.405588}2298gitlab # [ 254.587252] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:31.718Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"59597b0bc3e70e188e20577a","created_at":"2026-09-08T05:58:31.274Z","trace_propagation_headers":{"sentry-trace":"488cf9110d2f42e6a6d0393779bf473e-ba99f7842b1c4be1","baggage":"sentry-trace_id=488cf9110d2f42e6a6d0393779bf473e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"764fe936c1e93d860372464e05a29c8c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:31.276Z","job_size_bytes":2,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-59597b0bc3e70e188e20577a: done: 0.0359 sec","job_status":"done","queue_duration_s":0.405543,"scheduling_latency_s":0.405588,"redis_calls":11,"redis_duration_s":0.001792,"redis_read_bytes":9,"redis_write_bytes":1518,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000278,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000869,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000645,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023975,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000440559,"exclusive_lock_hold_duration_s":0.016475278,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.0359,"completed_at":"2026-09-08T05:58:31.718Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006789,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2299gitlab # [ 254.628033] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:31.719Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"0c206b0ab28107ead2e71bf4","created_at":"2026-09-08T05:58:31.278Z","trace_propagation_headers":{"sentry-trace":"488cf9110d2f42e6a6d0393779bf473e-ba99f7842b1c4be1","baggage":"sentry-trace_id=488cf9110d2f42e6a6d0393779bf473e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6408991e550b56623f6b7524cd002b01","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:31.286Z","job_size_bytes":2,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-0c206b0ab28107ead2e71bf4: start","job_status":"start","queue_duration_s":0.432511,"scheduling_latency_s":0.432528}2300gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/900b61437f51ef58d953b2d67b98812ee58b53c9/statuses2301gitlab # [ 254.628741] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:31.749Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"0c206b0ab28107ead2e71bf4","created_at":"2026-09-08T05:58:31.278Z","trace_propagation_headers":{"sentry-trace":"488cf9110d2f42e6a6d0393779bf473e-ba99f7842b1c4be1","baggage":"sentry-trace_id=488cf9110d2f42e6a6d0393779bf473e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6408991e550b56623f6b7524cd002b01","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:31.286Z","job_size_bytes":2,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-0c206b0ab28107ead2e71bf4: done: 0.029848 sec","job_status":"done","queue_duration_s":0.432511,"scheduling_latency_s":0.432528,"redis_calls":13,"redis_duration_s":0.001673,"redis_read_bytes":11,"redis_write_bytes":1780,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000479,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000634,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00056,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014111,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000284114,"exclusive_lock_hold_duration_s":0.015708141,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.029848,"completed_at":"2026-09-08T05:58:31.749Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011313,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2302gitlab # [ 254.663578] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:31.750Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"841f19ae30f7730c0e8a2342","created_at":"2026-09-08T05:58:31.301Z","trace_propagation_headers":{"sentry-trace":"488cf9110d2f42e6a6d0393779bf473e-ba99f7842b1c4be1","baggage":"sentry-trace_id=488cf9110d2f42e6a6d0393779bf473e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b44fbb8a7dee50a0e85f2ede650f96bb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-08T05:58:31.310Z","job_size_bytes":2,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-841f19ae30f7730c0e8a2342: start","job_status":"start","queue_duration_s":0.439686,"scheduling_latency_s":0.4397}2303gitlab # [ 254.712118] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:31.756Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}2304gitlab # [ 254.712895] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:31.761Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"841f19ae30f7730c0e8a2342","created_at":"2026-09-08T05:58:31.301Z","trace_propagation_headers":{"sentry-trace":"488cf9110d2f42e6a6d0393779bf473e-ba99f7842b1c4be1","baggage":"sentry-trace_id=488cf9110d2f42e6a6d0393779bf473e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b44fbb8a7dee50a0e85f2ede650f96bb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-08T05:58:31.310Z","job_size_bytes":2,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-841f19ae30f7730c0e8a2342: done: 0.01138 sec","job_status":"done","queue_duration_s":0.439686,"scheduling_latency_s":0.4397,"redis_calls":9,"redis_duration_s":0.001371,"redis_read_bytes":7,"redis_write_bytes":1152,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000237,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000905,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000229,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00638,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01138,"completed_at":"2026-09-08T05:58:31.761Z","load_balancing_strategy":"primary","db_duration_s":0.000292,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2305gitlab # [ 254.715173] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:31.762Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"7c346b0567492b7556f53b32","created_at":"2026-09-08T05:58:31.316Z","trace_propagation_headers":{"sentry-trace":"488cf9110d2f42e6a6d0393779bf473e-ba99f7842b1c4be1","baggage":"sentry-trace_id=488cf9110d2f42e6a6d0393779bf473e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"28f7771e1164e7b1ce246b3d6a653a27","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:31.327Z","job_size_bytes":2,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-7c346b0567492b7556f53b32: start","job_status":"start","queue_duration_s":0.435024,"scheduling_latency_s":0.435038}2306gitlab # [ 254.754651] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:31.775Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"7c346b0567492b7556f53b32","created_at":"2026-09-08T05:58:31.316Z","trace_propagation_headers":{"sentry-trace":"488cf9110d2f42e6a6d0393779bf473e-ba99f7842b1c4be1","baggage":"sentry-trace_id=488cf9110d2f42e6a6d0393779bf473e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"28f7771e1164e7b1ce246b3d6a653a27","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:31.327Z","job_size_bytes":2,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-7c346b0567492b7556f53b32: done: 0.013468 sec","job_status":"done","queue_duration_s":0.435024,"scheduling_latency_s":0.435038,"redis_calls":9,"redis_duration_s":0.001106,"redis_read_bytes":7,"redis_write_bytes":1026,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000234,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000638,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000234,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013468,"completed_at":"2026-09-08T05:58:31.775Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001901,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2307gitlab # [ 254.794706] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:31.777Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"33b118c234e64cfead0e4852","created_at":"2026-09-08T05:58:31.339Z","trace_propagation_headers":{"sentry-trace":"0eec2435558a4dcc9097c442d12e2e30-fe6f39b6aba34d32","baggage":"sentry-trace_id=0eec2435558a4dcc9097c442d12e2e30,sentry-release=Unknown"},"correlation_id":"01M1ZSHEWR0QVE0453WXSE6YR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:31.341Z","job_size_bytes":23,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-33b118c234e64cfead0e4852: start","job_status":"start","queue_duration_s":0.43627,"scheduling_latency_s":0.436306}2308gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/900b61437f51ef58d953b2d67b98812ee58b53c9/statuses, in 0.13 seconds)2309(finished: subtest: eval and build post commit statuses, in 5.79 seconds)2310(finished: run the VM test script, in 310.69 seconds)2311gitlab # [ 254.795433] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:31.807Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"33b118c234e64cfead0e4852","created_at":"2026-09-08T05:58:31.339Z","trace_propagation_headers":{"sentry-trace":"0eec2435558a4dcc9097c442d12e2e30-fe6f39b6aba34d32","baggage":"sentry-trace_id=0eec2435558a4dcc9097c442d12e2e30,sentry-release=Unknown"},"correlation_id":"01M1ZSHEWR0QVE0453WXSE6YR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:31.341Z","job_size_bytes":23,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-33b118c234e64cfead0e4852: done: 0.029836 sec","job_status":"done","queue_duration_s":0.43627,"scheduling_latency_s":0.436306,"redis_calls":7,"redis_duration_s":0.000971,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000716,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000255,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020873,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029836,"completed_at":"2026-09-08T05:58:31.807Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004865,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2312gitlab # [ 254.836796] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:31.808Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"aa60e26e4103ea77befc7894","created_at":"2026-09-08T05:58:31.334Z","trace_propagation_headers":{"sentry-trace":"488cf9110d2f42e6a6d0393779bf473e-ba99f7842b1c4be1","baggage":"sentry-trace_id=488cf9110d2f42e6a6d0393779bf473e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0474754a1f535bd0fabbeba841c8d327","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-08T05:58:31.341Z","job_size_bytes":2,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-aa60e26e4103ea77befc7894: start","job_status":"start","queue_duration_s":0.466122,"scheduling_latency_s":0.46614}2313gitlab # [ 254.837545] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:31.815Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}2314gitlab # [ 254.838065] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:31.823Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"aa60e26e4103ea77befc7894","created_at":"2026-09-08T05:58:31.334Z","trace_propagation_headers":{"sentry-trace":"488cf9110d2f42e6a6d0393779bf473e-ba99f7842b1c4be1","baggage":"sentry-trace_id=488cf9110d2f42e6a6d0393779bf473e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0474754a1f535bd0fabbeba841c8d327","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-08T05:58:31.341Z","job_size_bytes":2,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-aa60e26e4103ea77befc7894: done: 0.015691 sec","job_status":"done","queue_duration_s":0.466122,"scheduling_latency_s":0.46614,"redis_calls":9,"redis_duration_s":0.001329,"redis_read_bytes":7,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000238,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000786,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000305,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008945,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015691,"completed_at":"2026-09-08T05:58:31.823Z","load_balancing_strategy":"primary","db_duration_s":0.000242,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2315gitlab # [ 254.872874] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:58:32 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/900b61437f51ef58d953b2d67b98812ee58b53c9/statuses HTTP/1.1" 200 1334 "" "curl/8.21.0" 572316gitlab # [ 254.876097] gitaly[919]: time="2026-09-08T05:58:32.133Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSHFWY4CASS1AGGYT0V25M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-08T05:59:02.031" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-08T05:58:32.131" grpc.time_ms=0.815 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2317gitlab # [ 254.923755] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:31.824Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"ea0ef44e134c61d9ded4b987","created_at":"2026-09-08T05:58:31.349Z","trace_propagation_headers":{"sentry-trace":"488cf9110d2f42e6a6d0393779bf473e-ba99f7842b1c4be1","baggage":"sentry-trace_id=488cf9110d2f42e6a6d0393779bf473e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6ed54381503b4ec7057463da3714673b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:31.352Z","job_size_bytes":2,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-ea0ef44e134c61d9ded4b987: start","job_status":"start","queue_duration_s":0.471991,"scheduling_latency_s":0.472012}2318gitlab # [ 254.924531] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:31.832Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}2319gitlab # [ 254.924967] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:31.836Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"ea0ef44e134c61d9ded4b987","created_at":"2026-09-08T05:58:31.349Z","trace_propagation_headers":{"sentry-trace":"488cf9110d2f42e6a6d0393779bf473e-ba99f7842b1c4be1","baggage":"sentry-trace_id=488cf9110d2f42e6a6d0393779bf473e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6ed54381503b4ec7057463da3714673b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:31.352Z","job_size_bytes":2,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-ea0ef44e134c61d9ded4b987: done: 0.01172 sec","job_status":"done","queue_duration_s":0.471991,"scheduling_latency_s":0.472012,"redis_calls":9,"redis_duration_s":0.001088,"redis_read_bytes":7,"redis_write_bytes":1105,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000239,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000591,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000258,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007086,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01172,"completed_at":"2026-09-08T05:58:31.836Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000255,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2320gitlab # [ 254.965745] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:31.837Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"74ed8d1475f849f59ca886af","created_at":"2026-09-08T05:58:31.358Z","trace_propagation_headers":{"sentry-trace":"488cf9110d2f42e6a6d0393779bf473e-ba99f7842b1c4be1","baggage":"sentry-trace_id=488cf9110d2f42e6a6d0393779bf473e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5acba4f8762b93b5df10734413fceab7","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:31.361Z","job_size_bytes":2,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-74ed8d1475f849f59ca886af: start","job_status":"start","queue_duration_s":0.475334,"scheduling_latency_s":0.475348}2321gitlab # [ 254.966608] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:31.848Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"74ed8d1475f849f59ca886af","created_at":"2026-09-08T05:58:31.358Z","trace_propagation_headers":{"sentry-trace":"488cf9110d2f42e6a6d0393779bf473e-ba99f7842b1c4be1","baggage":"sentry-trace_id=488cf9110d2f42e6a6d0393779bf473e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5acba4f8762b93b5df10734413fceab7","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-08T05:58:31.361Z","job_size_bytes":2,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-74ed8d1475f849f59ca886af: done: 0.010851 sec","job_status":"done","queue_duration_s":0.475334,"scheduling_latency_s":0.475348,"redis_calls":11,"redis_duration_s":0.0013109999999999999,"redis_read_bytes":8,"redis_write_bytes":1094,"redis_cache_calls":2,"redis_cache_duration_s":0.000233,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000253,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.0006,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":482,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000225,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006429,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010851,"completed_at":"2026-09-08T05:58:31.848Z","load_balancing_strategy":"primary","db_duration_s":0.00022,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2322gitlab # [ 254.997227] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:58:32 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1312323gitlab # [ 254.998979] gitlab-workhorse[834]: time="2026-09-08T05:58:32Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672324gitlab # [ 255.000678] gitlab-workhorse[834]: gitlab 2001:db8:1::1 - - [2026/09/08:05:58:32 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 462325gitlab # [ 255.040770] gitaly[919]: time="2026-09-08T05:58:32.274Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=92 command.spawn_token_fork_ms=90 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1ZSHFYFARVVC71RAHJHK24X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:58:32.180" grpc.time_ms=94.062 pid=919 remote_ip="2001:db8:1::1" span.kind=server system=grpc2326gitlab # [ 255.041726] gitaly[919]: time="2026-09-08T05:58:32.322Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1ZSHG2MPQMFHJ1GHJ3KNTF0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-08T05:58:32.315" pid=919 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2327test script finished in 310.93s2328cleanup2329kill QemuMachine (pid 46)2330gitlab # [ 255.042523] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-08T05:58:31.849Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"b041ae43cb135e7b0f1b8fd6","created_at":"2026-09-08T05:58:31.366Z","trace_propagation_headers":{"sentry-trace":"488cf9110d2f42e6a6d0393779bf473e-ba99f7842b1c4be1","baggage":"sentry-trace_id=488cf9110d2f42e6a6d0393779bf473e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f3cbe28995fcf0b6197243a0522c4251","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sourqemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14)2331gitlab # c2332(finished: cleanup, in 1.37 seconds)2333additionally exposed symbols:2334 gitlab,2335 vlan1,2336 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2337[]2338[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-09-08T05:57:37.835Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2339[]2340[]2341[]2342[]2343[]2344[]2345[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '900b61437f51ef58d953b2d67b98812ee58b53c9', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-09-08T05:58:24.559935Z', 'started_at': '2026-09-08T05:58:25.091027Z', 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': None}]2346[{'id': 5, 'sha': '900b61437f51ef58d953b2d67b98812ee58b53c9', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-08T05:58:25.067Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2347[{'id': 5, 'sha': '900b61437f51ef58d953b2d67b98812ee58b53c9', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-08T05:58:25.067Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2348[{'id': 5, 'sha': '900b61437f51ef58d953b2d67b98812ee58b53c9', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-08T05:58:25.067Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2349[{'id': 5, 'sha': '900b61437f51ef58d953b2d67b98812ee58b53c9', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-08T05:58:25.067Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2350[{'id': 5, 'sha': '900b61437f51ef58d953b2d67b98812ee58b53c9', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-08T05:58:25.067Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2351[{'id': 5, 'sha': '900b61437f51ef58d953b2d67b98812ee58b53c9', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 5s (1 warning)', 'created_at': '2026-09-08T05:58:25.067Z', 'started_at': None, 'finished_at': '2026-09-08T05:58:31.169Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '900b61437f51ef58d953b2d67b98812ee58b53c9', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-09-08T05:58:31.327Z', 'started_at': None, 'finished_at': '2026-09-08T05:58:31.459Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]