vm-test-run-nixbot-gitlab
default.checks.x86_64-linux.nixbot-gitlab
· build #201
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 13)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.US6BR0zsS8', fmt=raw size=107374182412gitlab # mke2fs 1.47.3 (8-Jul-2025)13gitlab # Discarding device blocks: 0/262144 done14gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes15gitlab # Filesystem UUID: 0e27d305-6fc2-4f9b-9a67-67d6106ff2f616gitlab # Superblock backups stored on blocks:17gitlab # 32768, 98304, 163840, 22937618gitlab # 19gitlab # Allocating group tables: 0/8 done20gitlab # Writing inode tables: 0/8 done21gitlab # Creating journal (8192 blocks): done22gitlab # Writing superblocks and filesystem accounting information: 0/8 done23gitlab # 24gitlab # Virtualisation disk image created.25gitlab # Creating Nix store image...26gitlab # Created Nix store image.27(finished: start all VMs, in 34.82 seconds)28gitlab: waiting for unit setup-gitlab.service29gitlab: waiting for the VM to finish booting30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.34 (nixbld@localhost) (gcc (GCC) 15.2.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Jun 1 15:51:08 UTC 202645gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/h7wd45w3kar8s1z37dm6ggs7yflpylx9-nixos-system-gitlab-test/init regInfo=/nix/store/iys4y53ygf6rz2nr7gqq5spkfq6fd4qr-closure-info/registration console=ttyS0,115200n8 console=tty046gitlab # [ 0.000000] BIOS-provided physical RAM map:47gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable48gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved49gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable51gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable55gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved56gitlab # [ 0.000000] NX (Execute Disable) protection: active57gitlab # [ 0.000000] APIC: Static calls initialized58gitlab # [ 0.000000] SMBIOS 2.8 present.59gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201460gitlab # [ 0.000000] DMI: Memory slots populated: 1/161gitlab # [ 0.000000] Hypervisor detected: KVM62gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000063gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0064gitlab # [ 0.000000] kvm-clock: using sched offset of 533748714 cycles65gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns66gitlab # [ 0.000005] tsc: Detected 2400.008 MHz processor67gitlab # [ 0.000812] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000068gitlab # [ 0.000849] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs69gitlab # [ 0.000852] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT70gitlab # [ 0.000904] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000071gitlab # [ 0.002759] found SMP MP-table at [mem 0x000f5470-0x000f547f]72gitlab # [ 0.002769] Using GB pages for direct mapping73gitlab # [ 0.002921] RAMDISK: [mem 0xbe4e0000-0xbffcffff]74gitlab # [ 0.002927] ACPI: Early table checksum verification disabled75gitlab # [ 0.002930] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )76gitlab # [ 0.002934] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)77gitlab # [ 0.002937] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002943] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002945] ACPI: FACS 0x00000000BFFE0000 00004080gitlab # [ 0.002947] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)81gitlab # [ 0.002948] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002950] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002951] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]84gitlab # [ 0.002952] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]85gitlab # [ 0.002953] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]86gitlab # [ 0.002954] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]87gitlab # [ 0.002954] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]88gitlab # [ 0.002954] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]89gitlab # [ 0.003440] No NUMA configuration found90gitlab # [ 0.003442] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]91gitlab # [ 0.003445] NODE_DATA(0) allocated [mem 0x1bfffa780-0x1bffffcff]92gitlab # [ 0.005765] Zone ranges:93gitlab # [ 0.005766] DMA [mem 0x0000000000001000-0x0000000000ffffff]94gitlab # [ 0.005768] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]95gitlab # [ 0.005769] Normal [mem 0x0000000100000000-0x00000001bfffffff]96gitlab # [ 0.005770] Device empty97gitlab # [ 0.005770] Movable zone start for each node98gitlab # [ 0.005771] Early memory node ranges99gitlab # [ 0.005771] node 0: [mem 0x0000000000001000-0x000000000009efff]100gitlab # [ 0.005772] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]101gitlab # [ 0.005773] node 0: [mem 0x0000000100000000-0x00000001bfffffff]102gitlab # [ 0.005774] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]103gitlab # [ 0.005803] On node 0, zone DMA: 1 pages in unavailable ranges104gitlab # [ 0.006070] On node 0, zone DMA: 97 pages in unavailable ranges105gitlab # [ 0.115033] On node 0, zone Normal: 40 pages in unavailable ranges106gitlab # [ 0.116048] ACPI: PM-Timer IO Port: 0x608107gitlab # [ 0.116065] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])108gitlab # [ 0.116103] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23109gitlab # [ 0.116106] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)110gitlab # [ 0.116108] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)111gitlab # [ 0.116108] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)112gitlab # [ 0.116110] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)113gitlab # [ 0.116110] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)114gitlab # [ 0.116113] ACPI: Using ACPI (MADT) for SMP configuration information115gitlab # [ 0.116114] ACPI: HPET id: 0x8086a201 base: 0xfed00000116gitlab # [ 0.116120] TSC deadline timer available117gitlab # [ 0.116124] CPU topo: Max. logical packages: 1118gitlab # [ 0.116125] CPU topo: Max. logical dies: 1119gitlab # [ 0.116126] CPU topo: Max. dies per package: 1120gitlab # [ 0.116129] CPU topo: Max. threads per core: 1121gitlab # [ 0.116129] CPU topo: Num. cores per package: 4122gitlab # [ 0.116130] CPU topo: Num. threads per package: 4123gitlab # [ 0.116130] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs124gitlab # [ 0.116154] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()125gitlab # [ 0.116171] kvm-guest: KVM setup pv remote TLB flush126gitlab # [ 0.116175] kvm-guest: setup PV sched yield127gitlab # [ 0.116194] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]128gitlab # [ 0.116195] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]129gitlab # [ 0.116196] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]130gitlab # [ 0.116198] [mem 0xc0000000-0xfeffbfff] available for PCI devices131gitlab # [ 0.116199] Booting paravirtualized kernel on KVM132gitlab # [ 0.116202] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns133gitlab # [ 0.120656] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1134gitlab # [ 0.122913] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288135gitlab # [ 0.122964] kvm-guest: PV spinlocks enabled136gitlab # [ 0.122966] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)137gitlab # [ 0.122968] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/h7wd45w3kar8s1z37dm6ggs7yflpylx9-nixos-system-gitlab-test/init regInfo=/nix/store/iys4y53ygf6rz2nr7gqq5spkfq6fd4qr-closure-info/registration console=ttyS0,115200n8 console=tty0138gitlab # [ 0.123061] Unknown kernel command line parameters "regInfo=/nix/store/iys4y53ygf6rz2nr7gqq5spkfq6fd4qr-closure-info/registration", will be passed to user space.139gitlab # [ 0.123074] random: crng init done140gitlab # [ 0.123075] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes141gitlab # [ 0.132021] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)142gitlab # [ 0.136382] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)143gitlab # [ 0.136458] software IO TLB: area num 4.144gitlab # [ 0.210850] Fallback order for Node 0: 0145gitlab # [ 0.210857] Built 1 zonelists, mobility grouping on. Total pages: 1572726146gitlab # [ 0.210859] Policy zone: Normal147gitlab # [ 0.213413] mem auto-init: stack:all(zero), heap alloc:on, heap free:off148gitlab # [ 0.222499] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1149gitlab # [ 0.236111] allocated 12582912 bytes of page_ext150gitlab # [ 0.245998] ftrace: allocating 48565 entries in 192 pages151gitlab # [ 0.246000] ftrace: allocated 192 pages with 2 groups152gitlab # [ 0.246849] Dynamic Preempt: lazy153gitlab # [ 0.247037] rcu: Preemptible hierarchical RCU implementation.154gitlab # [ 0.247038] rcu: RCU event tracing is enabled.155gitlab # [ 0.247039] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.156gitlab # [ 0.247040] Trampoline variant of Tasks RCU enabled.157gitlab # [ 0.247041] Rude variant of Tasks RCU enabled.158gitlab # [ 0.247041] Tracing variant of Tasks RCU enabled.159gitlab # [ 0.247042] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.160gitlab # [ 0.247043] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4161gitlab # [ 0.247072] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.162gitlab # [ 0.247074] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.247075] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.251435] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16165gitlab # [ 0.251721] rcu: srcu_init: Setting srcu_struct sizes based on contention.166gitlab # [ 0.251839] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)167gitlab # [ 0.259083] Console: colour VGA+ 80x25168gitlab # [ 0.259087] printk: legacy console [tty0] enabled169gitlab # [ 0.302972] printk: legacy console [ttyS0] enabled170gitlab # [ 0.501784] ACPI: Core revision 20250807171gitlab # [ 0.503442] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns172gitlab # [ 0.506252] APIC: Switch to symmetric I/O mode setup173gitlab # [ 0.507987] x2apic enabled174gitlab # [ 0.509210] APIC: Switched APIC routing to: physical x2apic175gitlab # [ 0.510957] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()176gitlab # [ 0.513177] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()177gitlab # [ 0.515927] kvm-guest: setup PV IPIs178gitlab # [ 0.518360] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1179gitlab # [ 0.520168] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns180gitlab # [ 0.523304] Calibrating delay loop (skipped) preset value.. 4800.01 BogoMIPS (lpj=2400008)181gitlab # [ 0.524420] x86/cpu: User Mode Instruction Prevention (UMIP) activated182gitlab # [ 0.526448] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127183gitlab # [ 0.528303] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0184gitlab # [ 0.529306] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto185gitlab # [ 0.531303] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl186gitlab # [ 0.533303] Transient Scheduler Attacks: Mitigation: Clear CPU buffers187gitlab # [ 0.534302] Spectre V2 : Mitigation: Enhanced / Automatic IBRS188gitlab # [ 0.535303] Speculative Return Stack Overflow: Mitigation: Safe RET189gitlab # [ 0.536302] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization190gitlab # [ 0.537308] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier191gitlab # [ 0.539303] active return thunk: srso_alias_return_thunk192gitlab # [ 0.540332] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'193gitlab # [ 0.542302] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'194gitlab # [ 0.543303] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'195gitlab # [ 0.545303] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'196gitlab # [ 0.547302] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'197gitlab # [ 0.549302] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'198gitlab # [ 0.550303] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'199gitlab # [ 0.551303] x86/fpu: Supporting XSAVE feature 0x800: 'Control-flow User registers'200gitlab # [ 0.553303] x86/fpu: Supporting XSAVE feature 0x1000: 'Control-flow Kernel registers (KVM only)'201gitlab # [ 0.554303] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256202gitlab # [ 0.556302] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64203gitlab # [ 0.557303] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512204gitlab # [ 0.558303] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024205gitlab # [ 0.559303] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8206gitlab # [ 0.561303] x86/fpu: xstate_offset[11]: 2440, xstate_sizes[11]: 16207gitlab # [ 0.563303] x86/fpu: xstate_offset[12]: 2456, xstate_sizes[12]: 24208gitlab # [ 0.565302] x86/fpu: Enabled xstate features 0x1ae7, context size is 2480 bytes, using 'compacted' format.209gitlab # [ 0.595376] Freeing SMP alternatives memory: 44K210gitlab # [ 0.596305] pid_max: default: 32768 minimum: 301211gitlab # [ 0.598329] LSM: initializing lsm=capability,landlock,yama,bpf,ima212gitlab # [ 0.599403] landlock: Up and running.213gitlab # [ 0.601303] Yama: becoming mindful.214gitlab # [ 0.602521] LSM support for eBPF active215gitlab # [ 0.603528] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)216gitlab # [ 0.605460] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)217gitlab # [ 0.608232] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)218gitlab # [ 0.608877] Performance Events: Fam17h+ core perfctr, AMD PMU driver.219gitlab # [ 0.609307] ... version: 2220gitlab # [ 0.610304] ... bit width: 48221gitlab # [ 0.611318] ... generic counters: 6222gitlab # [ 0.612304] ... generic bitmap: 000000000000003f223gitlab # [ 0.613304] ... fixed-purpose counters: 0224gitlab # [ 0.614305] ... fixed-purpose bitmap: 0000000000000000225gitlab # [ 0.615304] ... value mask: 0000ffffffffffff226gitlab # [ 0.616304] ... max period: 00007fffffffffff227gitlab # [ 0.617304] ... global_ctrl mask: 000000000000003f228gitlab # [ 0.618423] signal: max sigframe size: 3376229gitlab # [ 0.619426] rcu: Hierarchical SRCU implementation.230gitlab # [ 0.620309] rcu: Max phase no-delay instances is 400.231gitlab # [ 0.621512] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level232gitlab # [ 0.626862] smp: Bringing up secondary CPUs ...233gitlab # [ 0.627716] smpboot: x86: Booting SMP configuration:234gitlab # [ 0.628307] .... node #0, CPUs: #1 #2 #3235gitlab # [ 0.632465] smp: Brought up 1 node, 4 CPUs236gitlab # [ 0.635307] smpboot: Total of 4 processors activated (19200.06 BogoMIPS)237gitlab # [ 0.636888] Memory: 6013124K/6290904K available (17098K kernel code, 2721K rwdata, 13520K rodata, 3644K init, 3008K bss, 258292K reserved, 0K cma-reserved)238gitlab # [ 0.639304] devtmpfs: initialized239gitlab # [ 0.640530] x86/mm: Memory block size: 128MB240gitlab # [ 0.643491] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns241gitlab # [ 0.645359] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)242gitlab # [ 0.646393] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).243gitlab # [ 0.647418] pinctrl core: initialized pinctrl subsystem244gitlab # [ 0.648759] PM: RTC time: 09:39:19, date: 2026-08-11245gitlab # [ 0.652147] NET: Registered PF_NETLINK/PF_ROUTE protocol family246gitlab # [ 0.654861] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations247gitlab # [ 0.655360] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations248gitlab # [ 0.657420] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations249gitlab # [ 0.658318] audit: initializing netlink subsys (disabled)250gitlab # [ 0.659509] audit: type=2000 audit(1786441159.252:1): state=initialized audit_enabled=0 res=1251gitlab # [ 0.659663] thermal_sys: Registered thermal governor 'fair_share'252gitlab # [ 0.661305] thermal_sys: Registered thermal governor 'bang_bang'253gitlab # [ 0.662305] thermal_sys: Registered thermal governor 'step_wise'254gitlab # [ 0.663305] thermal_sys: Registered thermal governor 'user_space'255gitlab # [ 0.664305] thermal_sys: Registered thermal governor 'power_allocator'256gitlab # [ 0.665324] cpuidle: using governor menu257gitlab # [ 0.668553] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5258gitlab # [ 0.669642] PCI: Using configuration type 1 for base access259gitlab # [ 0.670305] PCI: Using configuration type 1 for extended access260gitlab # [ 0.671489] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.261gitlab # [ 0.673702] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages262gitlab # [ 0.675312] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page263gitlab # [ 0.676305] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages264gitlab # [ 0.677305] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page265gitlab # [ 0.682930] ACPI: Added _OSI(Module Device)266gitlab # [ 0.686313] ACPI: Added _OSI(Processor Device)267gitlab # [ 0.689315] ACPI: Added _OSI(Processor Aggregator Device)268gitlab # [ 0.698292] ACPI: 1 ACPI AML tables successfully acquired and loaded269gitlab # [ 0.707574] ACPI: Interpreter enabled270gitlab # [ 0.708326] ACPI: PM: (supports S0 S3 S4 S5)271gitlab # [ 0.709306] ACPI: Using IOAPIC for interrupt routing272gitlab # [ 0.710350] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug273gitlab # [ 0.711315] PCI: Using E820 reservations for host bridge windows274gitlab # [ 0.716677] ACPI: Enabled 2 GPEs in block 00 to 0F275gitlab # [ 0.733248] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])276gitlab # [ 0.737328] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]277gitlab # [ 0.744835] acpiphp: Slot [3] registered278gitlab # [ 0.748411] acpiphp: Slot [4] registered279gitlab # [ 0.751390] acpiphp: Slot [5] registered280gitlab # [ 0.753387] acpiphp: Slot [6] registered281gitlab # [ 0.755417] acpiphp: Slot [7] registered282gitlab # [ 0.758391] acpiphp: Slot [8] registered283gitlab # [ 0.760385] acpiphp: Slot [9] registered284gitlab # [ 0.763413] acpiphp: Slot [10] registered285gitlab # [ 0.765407] acpiphp: Slot [11] registered286gitlab # [ 0.767389] acpiphp: Slot [12] registered287gitlab # [ 0.770347] acpiphp: Slot [13] registered288gitlab # [ 0.771355] acpiphp: Slot [14] registered289gitlab # [ 0.772338] acpiphp: Slot [15] registered290gitlab # [ 0.773345] acpiphp: Slot [16] registered291gitlab # [ 0.775339] acpiphp: Slot [17] registered292gitlab # [ 0.776357] acpiphp: Slot [18] registered293gitlab # [ 0.777339] acpiphp: Slot [19] registered294gitlab # [ 0.778759] acpiphp: Slot [20] registered295gitlab # [ 0.782459] acpiphp: Slot [21] registered296gitlab # [ 0.785396] acpiphp: Slot [22] registered297gitlab # [ 0.788394] acpiphp: Slot [23] registered298gitlab # [ 0.792395] acpiphp: Slot [24] registered299gitlab # [ 0.795425] acpiphp: Slot [25] registered300gitlab # [ 0.798394] acpiphp: Slot [26] registered301gitlab # [ 0.801414] acpiphp: Slot [27] registered302gitlab # [ 0.804429] acpiphp: Slot [28] registered303gitlab # [ 0.807395] acpiphp: Slot [29] registered304gitlab # [ 0.811422] acpiphp: Slot [30] registered305gitlab # [ 0.814393] acpiphp: Slot [31] registered306gitlab # [ 0.817501] PCI host bridge to bus 0000:00307gitlab # [ 0.820329] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]308gitlab # [ 0.825345] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]309gitlab # [ 0.830313] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]310gitlab # [ 0.834312] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]311gitlab # [ 0.839313] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]312gitlab # [ 0.844318] pci_bus 0000:00: root bus resource [bus 00-ff]313gitlab # [ 0.847637] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint314gitlab # [ 0.853600] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint315gitlab # [ 0.861503] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint316gitlab # [ 0.872471] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]317gitlab # [ 0.876467] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk318gitlab # [ 0.881314] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk319gitlab # [ 0.885311] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk320gitlab # [ 0.889312] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk321gitlab # [ 0.892964] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint322gitlab # [ 0.900432] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]323gitlab # [ 0.903563] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint324gitlab # [ 0.906973] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI325gitlab # [ 0.909381] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB326gitlab # [ 0.917346] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint327gitlab # [ 0.941477] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]328gitlab # [ 0.946406] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]329gitlab # [ 0.951443] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]330gitlab # [ 0.957321] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]331gitlab # [ 0.987320] pci 0000:00:02.0: pci_fixup_video+0x0/0x100 took 30273 usecs332gitlab # [ 0.991094] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint333gitlab # [ 0.997341] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]334gitlab # [ 0.999321] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]335gitlab # [ 1.000358] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]336gitlab # [ 1.003320] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]337gitlab # [ 1.007578] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint338gitlab # [ 1.013332] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]339gitlab # [ 1.014320] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]340gitlab # [ 1.017358] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]341gitlab # [ 1.021332] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint342gitlab # [ 1.025339] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]343gitlab # [ 1.027321] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]344gitlab # [ 1.029357] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]345gitlab # [ 1.033408] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint346gitlab # [ 1.039544] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]347gitlab # [ 1.042320] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]348gitlab # [ 1.043357] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]349gitlab # [ 1.047396] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint350gitlab # [ 1.054331] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]351gitlab # [ 1.055320] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]352gitlab # [ 1.057360] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]353gitlab # [ 1.066803] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint354gitlab # [ 1.083349] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]355gitlab # [ 1.088350] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]356gitlab # [ 1.092473] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]357gitlab # [ 1.103378] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint358gitlab # [ 1.116340] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]359gitlab # [ 1.119340] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]360gitlab # [ 1.123422] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]361gitlab # [ 1.128384] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]362gitlab # [ 1.133125] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint363gitlab # [ 1.145380] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]364gitlab # [ 1.149453] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]365gitlab # [ 1.158336] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint366gitlab # [ 1.168368] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]367gitlab # [ 1.170319] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]368gitlab # [ 1.172356] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]369gitlab # [ 1.177306] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint370gitlab # [ 1.181339] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]371gitlab # [ 1.183319] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]372gitlab # [ 1.185357] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]373gitlab # [ 1.194395] ACPI: PCI: Interrupt link LNKA configured for IRQ 10374gitlab # [ 1.197478] ACPI: PCI: Interrupt link LNKB configured for IRQ 10375gitlab # [ 1.201687] ACPI: PCI: Interrupt link LNKC configured for IRQ 11376gitlab # [ 1.204786] ACPI: PCI: Interrupt link LNKD configured for IRQ 11377gitlab # [ 1.209587] ACPI: PCI: Interrupt link LNKS configured for IRQ 9378gitlab # [ 1.218429] iommu: Default domain type: Translated379gitlab # [ 1.221312] iommu: DMA domain TLB invalidation policy: lazy mode380gitlab # [ 1.227525] ACPI: bus type USB registered381gitlab # [ 1.230513] usbcore: registered new interface driver usbfs382gitlab # [ 1.234589] usbcore: registered new interface driver hub383gitlab # [ 1.238430] usbcore: registered new device driver usb384gitlab # [ 1.246339] NetLabel: Initializing385gitlab # [ 1.249312] NetLabel: domain hash size = 128386gitlab # [ 1.252311] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO387gitlab # [ 1.257571] NetLabel: unlabeled traffic allowed by default388gitlab # [ 1.261347] PCI: Using ACPI for IRQ routing389gitlab # [ 1.266476] pci 0000:00:02.0: vgaarb: setting as boot VGA device390gitlab # [ 1.267300] pci 0000:00:02.0: vgaarb: bridge control possible391gitlab # [ 1.267300] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none392gitlab # [ 1.280321] vgaarb: loaded393gitlab # [ 1.283856] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0394gitlab # [ 1.287312] hpet0: 3 comparators, 64-bit 100.000000 MHz counter395gitlab # [ 1.294305] clocksource: Switched to clocksource kvm-clock396gitlab # [ 1.302760] VFS: Disk quotas dquot_6.6.0397gitlab # [ 1.305900] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)398gitlab # [ 1.311831] pnp: PnP ACPI init399gitlab # [ 1.315957] pnp: PnP ACPI: found 6 devices400gitlab # [ 1.333289] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns401gitlab # [ 1.339760] clocksource: Switched to clocksource acpi_pm402gitlab # [ 1.344146] NET: Registered PF_INET protocol family403gitlab # [ 1.351393] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)404gitlab # [ 1.384386] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)405gitlab # [ 1.387014] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)406gitlab # [ 1.389402] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)407gitlab # [ 1.394163] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)408gitlab # [ 1.396503] TCP: Hash tables configured (established 65536 bind 65536)409gitlab # [ 1.399189] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)410gitlab # [ 1.405137] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)411gitlab # [ 1.410267] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)412gitlab # [ 1.416100] NET: Registered PF_UNIX/PF_LOCAL protocol family413gitlab # [ 1.420720] NET: Registered PF_XDP protocol family414gitlab # [ 1.424469] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]415gitlab # [ 1.429197] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]416gitlab # [ 1.433892] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]417gitlab # [ 1.439079] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]418gitlab # [ 1.444242] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]419gitlab # [ 1.450013] pci 0000:00:01.0: PIIX3: Enabling Passive Release420gitlab # [ 1.453692] pci 0000:00:00.0: Limiting direct PCI/PCI transfers421gitlab # [ 1.460750] ACPI: \_SB_.LNKD: Enabled at IRQ 11422gitlab # [ 1.469168] pci 0000:00:01.2: quirk_usb_early_handoff+0x0/0x7c0 took 11499 usecs423gitlab # [ 1.475174] PCI: CLS 0 bytes, default 64424gitlab # [ 1.478562] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)425gitlab # [ 1.478775] Trying to unpack rootfs image as initramfs...426gitlab # [ 1.479445] software IO TLB: mapped [mem 0x00000000ba4e0000-0x00000000be4e0000] (64MB)427gitlab # [ 1.493017] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns428gitlab # [ 1.541100] Initialise system trusted keyrings429gitlab # [ 1.545297] workingset: timestamp_bits=40 max_order=21 bucket_order=0430gitlab # [ 1.575910] Key type asymmetric registered431gitlab # [ 1.578512] Asymmetric key parser 'x509' registered432gitlab # [ 1.581757] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)433gitlab # [ 1.586780] io scheduler mq-deadline registered434gitlab # [ 1.589663] io scheduler kyber registered435gitlab # [ 1.595726] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled436gitlab # [ 1.601392] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A437gitlab # [ 1.610973] Linux agpgart interface v0.103438gitlab # [ 1.614411] ACPI: bus type drm_connector registered439gitlab # [ 1.621905] usbcore: registered new interface driver usbserial_generic440gitlab # [ 1.623938] usbserial: USB Serial support registered for generic441gitlab # [ 1.625764] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.442gitlab # [ 1.625764] Please enable it if your BIOS has the CPPC option.443gitlab # [ 1.629763] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled444gitlab # [ 1.632241] drop_monitor: Initializing network drop monitor service445gitlab # [ 1.634289] NET: Registered PF_INET6 protocol family446gitlab # [ 1.637182] Segment Routing with IPv6447gitlab # [ 1.638416] In-situ OAM (IOAM) with IPv6448gitlab # [ 1.644623] IPI shorthand broadcast: enabled449gitlab # [ 1.649789] sched_clock: Marking stable (1390023326, 259570992)->(1727201973, -77607655)450gitlab # [ 1.652996] registered taskstats version 1451gitlab # [ 1.654604] Loading compiled-in X.509 certificates452gitlab # [ 1.676336] Demotion targets for Node 0: null453gitlab # [ 1.680270] Key type .fscrypt registered454gitlab # [ 1.683364] Key type fscrypt-provisioning registered455gitlab # [ 1.687425] ima: No TPM chip found, activating TPM-bypass!456gitlab # [ 1.691530] ima: Allocated hash algorithm: sha1457gitlab # [ 1.695132] ima: No architecture policies found458gitlab # [ 1.698698] PM: Magic number: 6:923:676459gitlab # [ 1.703151] RAS: Correctable Errors collector initialized.460gitlab # [ 1.712402] clk: Disabling unused clocks461gitlab # [ 1.713742] PM: genpd: Disabling unused power domains462gitlab # [ 1.771737] Freeing initrd memory: 27584K463gitlab # [ 1.777812] Freeing unused decrypted memory: 2028K464gitlab # [ 1.785753] Freeing unused kernel image (initmem) memory: 3644K465gitlab # [ 1.790291] Write protecting the kernel read-only data: 32768k466gitlab # [ 1.797700] Freeing unused kernel image (text/rodata gap) memory: 1332K467gitlab # [ 1.803943] Freeing unused kernel image (rodata/data gap) memory: 816K468gitlab # [ 1.863247] x86/mm: Checked W+X mappings: passed, no W+X pages found.469gitlab # [ 1.865230] Run /init as init process470gitlab # [ 1.881518] systemd[1]: Inserted module 'autofs4'471gitlab # [ 1.909888] fuse: init (API version 7.45)472gitlab # [ 1.920727] ACPI: \_SB_.LNKC: Enabled at IRQ 10473gitlab # [ 1.942168] ACPI: \_SB_.LNKA: Enabled at IRQ 10474gitlab # [ 1.946799] ACPI: \_SB_.LNKB: Enabled at IRQ 11475gitlab # [ 1.996475] systemd[1]: Successfully made /usr/ read-only.476gitlab # [ 2.340301] systemd[1]: systemd 260.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)477gitlab # [ 2.361756] systemd[1]: Detected virtualization kvm.478gitlab # [ 2.365718] systemd[1]: Detected architecture x86-64.479gitlab # [ 2.369695] systemd[1]: Running in initrd.480gitlab # [ 2.374205] systemd[1]: Initializing machine ID from random generator.481gitlab # [ 2.379345] systemd[1]: Hostname set to <gitlab>.482gitlab # [ 2.471185] systemd[1]: Queued start job for default target Initrd Default Target.483gitlab # [ 2.614890] systemd[1]: Created slice Slice /system/modprobe.484gitlab # [ 2.619988] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.485gitlab # [ 2.626069] systemd[1]: Expecting device /dev/disk/by-label/nix-store...486gitlab # [ 2.631172] systemd[1]: Expecting device /dev/disk/by-label/nixos...487gitlab # [ 2.636135] systemd[1]: Reached target Path Units.488gitlab # [ 2.640068] systemd[1]: Reached target Slice Units.489gitlab # [ 2.644113] systemd[1]: Reached target Swaps.490gitlab # [ 2.647871] systemd[1]: Reached target Timer Units.491gitlab # [ 2.651723] systemd[1]: Listening on D-Bus System Message Bus Socket.492gitlab # [ 2.655966] systemd[1]: Listening on Journal Socket (/dev/log).493gitlab # [ 2.660109] systemd[1]: Listening on Journal Sockets.494gitlab # [ 2.663571] systemd[1]: Listening on udev Control Socket.495gitlab # [ 2.667216] systemd[1]: Listening on udev Kernel Socket.496gitlab # [ 2.669232] systemd[1]: Reached target Socket Units.497gitlab # [ 2.675648] systemd[1]: Starting Create List of Static Device Nodes...498gitlab # [ 2.681893] systemd[1]: Starting Load Kernel Module 9pnet_virtio...499gitlab # [ 2.695166] systemd[1]: Starting Load Kernel Module configfs...500gitlab # [ 2.700456] systemd[1]: Starting Journal Service...501gitlab # [ 2.709331] systemd[1]: Starting Load Kernel Modules...502gitlab # [ 2.711070] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki503gitlab # [ 2.716322] systemd[1]: Starting Coldplug All udev Devices...504gitlab # [ 2.742228] systemd[1]: Finished Create List of Static Device Nodes.505gitlab # [ 2.744315] systemd-journald[151]: Collecting audit messages is disabled.506gitlab # [ 2.746879] systemd[1]: modprobe@configfs.service: Deactivated successfully.507gitlab # [ 2.755930] systemd[1]: Finished Load Kernel Module configfs.508gitlab # [ 2.757339] netfs: FS-Cache loaded509gitlab # [ 2.761232] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config510gitlab # [ 2.766086] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.511gitlab # [ 2.770921] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...512gitlab # [ 2.776025] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev513gitlab # [ 2.780391] 9pnet: Installing 9P2000 support514gitlab # [ 2.787561] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.515gitlab # [ 2.792116] systemd[1]: Finished Load Kernel Module 9pnet_virtio.516gitlab # [ 2.798838] systemd[1]: Finished Load Kernel Modules.517gitlab # [ 2.802773] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.518gitlab # [ 2.808465] systemd[1]: Starting Apply Kernel Variables...519gitlab # [ 2.812311] systemd[1]: Starting Create Static Device Nodes in /dev...520gitlab # [ 2.824705] systemd[1]: Finished Apply Kernel Variables.521gitlab # [ 2.566905] systemd-modules-load[155]: Using 4 probe threads522gitlab # [ 2.569254] systemd-modules-load[155]: Insert[ 2.829046] systemd[1]: Started Journal Service.523gitlab # ed module 'virtio_balloon'524gitlab # [ 2.571966] systemd-modules-load[155]: Inserted module 'dm_mod'525gitlab # [ 2.573799] systemd-modules-load[155]: Inserted module 'virtio_gpu'526gitlab # [ 2.575587] systemd[1]: Finished Create Static Device Nodes in /dev.527gitlab # [ 2.582169] systemd[1]: Reached target Preparation for Local File Systems.528gitlab # [ 2.583929] systemd[1]: Reached target Local File Systems.529gitlab # [ 2.585988] systemd[1]: Starting Create System Files and Directories...530gitlab # [ 2.589607] systemd[1]: Starting Rule-based Manager for Device Events and Files...531gitlab # [ 2.613494] systemd[1]: Finished Create System Files and Directories.532gitlab # [ 2.620735] systemd-udevd[194]: Using default interface naming scheme 'v260'.533gitlab # [ 2.637243] systemd[1]: Started Rule-based Manager for Device Events and Files.534gitlab # [ 2.660376] systemd[1]: Finished Coldplug All udev Devices.535gitlab # [ 2.661939] systemd[1]: Reached target System Initialization.536gitlab # [ 2.664060] systemd[1]: Reached target Basic System.537gitlab # [ 3.061116] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12538gitlab # [ 3.065347] serio: i8042 KBD port at 0x60,0x64 irq 1539gitlab # [ 3.066643] serio: i8042 AUX port at 0x60,0x64 irq 12540gitlab # [ 3.087908] virtio_blk virtio4: 4/0/0 default/read/poll queues541gitlab # [ 3.097748] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)542gitlab # [ 3.102211] uhci_hcd 0000:00:01.2: UHCI Host Controller543gitlab # [ 3.104644] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1544gitlab # [ 3.106465] uhci_hcd 0000:00:01.2: detected 2 ports545gitlab # [ 3.109974] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140546gitlab # [ 3.110144] SCSI subsystem initialized547gitlab # [ 3.111329] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18548gitlab # [ 3.114468] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1549gitlab # [ 3.116299] usb usb1: Product: UHCI Host Controller550gitlab # [ 3.117521] usb usb1: Manufacturer: Linux 6.18.34 uhci_hcd551gitlab # [ 3.119010] usb usb1: SerialNumber: 0000:00:01.2552gitlab # [ 3.123144] virtio_blk virtio5: 4/0/0 default/read/poll queues553gitlab # [ 3.125249] hub 1-0:1.0: USB hub found554gitlab # [ 3.127166] hub 1-0:1.0: 2 ports detected555gitlab # [ 3.134559] virtio_blk virtio5: [vdb] 11485984 512-byte logical blocks (5.88 GB/5.48 GiB)556gitlab # [ 3.143951] scsi host0: ata_piix557gitlab # [ 3.145447] scsi host1: ata_piix558gitlab # [ 3.146452] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0559gitlab # [ 3.148339] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0560gitlab # [ 2.905640] systemd[1]: Starting Virtual Console Setup...561gitlab # [ 2.907576] (udev-worker)[224]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.562gitlab # [ 2.920646] (udev-worker)[224]: Network interface NamePolicy= disabled on kernel command line.563gitlab # [ 2.923817] (udev-worker)[204]: Network interface NamePolicy= disabled on kernel command line.564gitlab # [ 2.930612] systemd-vconsole-setup[234]: Configuration of first virtual console was skipped, ignoring remaining ones.565gitlab # [ 2.933558] systemd[1]: Found device /dev/disk/by-label/nixos.566gitlab # [ 2.937193] systemd[1]: Finished Virtual Console Setup.567gitlab # [ 2.941548] systemd[1]: Found device /dev/disk/by-label/nix-store.568gitlab # [ 2.943176] systemd[1]: Reached target Initrd Root Device.569gitlab # [ 2.946056] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...570gitlab # [ 2.979525] systemd-fsck[244]: nixos: clean, 12/65536 files, 13019/262144 blocks571gitlab # [ 2.986874] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.572gitlab # [ 3.303322] ata2: found unknown device (class 0)573gitlab # [ 3.305431] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100574gitlab # [ 3.310498] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5575gitlab # [ 3.345517] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0576gitlab # [ 3.351774] usb 1-1: new full-speed USB device number 2 using uhci_hcd577gitlab # [ 3.385051] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray578gitlab # [ 3.418058] cdrom: Uniform CD-ROM driver Revision: 3.20579gitlab # [ 3.524046] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00580gitlab # [ 3.530054] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10581gitlab # [ 3.535401] usb 1-1: Product: QEMU USB Tablet582gitlab # [ 3.539137] usb 1-1: Manufacturer: QEMU583gitlab # [ 3.542075] usb 1-1: SerialNumber: 28754-0000:00:01.2-1584gitlab # [ 3.582376] hid: raw HID events driver (C) Jiri Kosina585gitlab # [ 3.597164] usbcore: registered new interface driver usbhid586gitlab # [ 3.599899] usbhid: USB HID core driver587gitlab # [ 3.611374] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2588gitlab # [ 3.615867] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0589gitlab # [ 3.483685] systemd[1]: Mounting /sysroot...590gitlab # [ 3.922260] EXT4-fs (vda): mounted filesystem 0e27d305-6fc2-4f9b-9a67-67d6106ff2f6 r/w with ordered data mode. Quota mode: none.591gitlab # [ 3.667777] systemd[1]: Mounted /sysroot.592gitlab # [ 3.669256] systemd[1]: Reached target Initrd Root File System.593gitlab # [ 3.673257] systemd[1]: Mounting /sysroot/nix/.ro-store...594gitlab # [ 3.675735] systemd[1]: Mounting /sysroot/nix/.rw-store...595gitlab # [ 3.678537] systemd[1]: Mounting /sysroot/run...596gitlab # [ 3.682186] systemd[1]: Mounting /sysroot/tmp/shared...597gitlab # [ 3.695461] systemd[1]: Mounting /sysroot/tmp/xchg...598gitlab # [ 3.700104] systemd[1]: Starting Mountpoints Configured in the Real Root...599gitlab # [ 3.709943] systemd[1]: Mounted /sysroot/nix/.rw-store.600gitlab # [ 3.711912] systemd[1]: Mount[ 3.971239] 9p: Installing v9fs 9p2000 file system support601gitlab # ed /sysroot/run.602gitlab # [ 3.976373] erofs (device vdb): mounted with root inode @ nid 128.603gitlab # [ 3.718348] systemd-sysroot-fstab-check[273]: /sysroot should be mounted in the initrd, will request daemon-reload.604gitlab # [ 3.720842] systemd[1]: Mounted /sysroot/tmp/shared.605gitlab # [ 3.722392] systemd[1]: Mounted /sysroot/tmp/xchg.606gitlab # [ 3.723740] systemd[1]: Mounted /sysroot/nix/.ro-store.607gitlab # [ 3.725238] systemd[1]: Reload requested from client PID 273 ('systemd-sysroot') (unit initrd-parse-etc.service)...608gitlab # [ 3.728055] systemd[1]: Reloading...609gitlab # [ 3.961700] systemd[1]: Reloading finished in 233 ms.610gitlab # [ 4.017480] systemd-sysroot-fstab-check[273]: Requesting initrd-fs.target/start/replace...611gitlab # [ 4.193314] systemd-sysroot-fstab-check[273]: Requesting swap.target/start/replace...612gitlab # [ 4.198983] systemd[1]: Starting rw-sysroot-nix-store.service...613gitlab # [ 4.202935] systemd[1]: initrd-parse-etc.service: Deactivated successfully.614gitlab # [ 4.207696] systemd[1]: Finished Mountpoints Configured in the Real Root.615gitlab # [ 4.212110] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.616gitlab # [ 4.227310] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.617gitlab # [ 4.231471] systemd[1]: Finished rw-sysroot-nix-store.service.618gitlab # [ 4.485146] systemd[1]: Mounting /sysroot/nix/store...619gitlab # [ 4.543305] systemd[1]: Mounted /sysroot/nix/store.620gitlab # [ 4.546961] systemd[1]: Reached target Initrd File Systems.621gitlab # [ 4.553505] systemd[1]: Starting Find NixOS closure...622gitlab # [ 4.558975] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...623gitlab # [ 4.595390] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.624gitlab # [ 4.600246] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.625gitlab # [ 4.620414] systemd[1]: Finished Find NixOS closure.626gitlab # [ 4.625756] systemd[1]: Reached target Initrd Default Target.627gitlab # [ 4.634256] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...628gitlab # [ 4.669316] systemd[1]: Stopped target Initrd Default Target.629gitlab # [ 4.672905] systemd[1]: Stopped target Basic System.630gitlab # [ 4.676170] systemd[1]: Stopped target Initrd Root Device.631gitlab # [ 4.679527] systemd[1]: Stopped target Path Units.632gitlab # [ 4.682576] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.633gitlab # [ 4.686954] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.634gitlab # [ 4.691545] systemd[1]: Stopped target Slice Units.635gitlab # [ 4.694690] systemd[1]: Stopped target Socket Units.636gitlab # [ 4.697832] systemd[1]: Stopped target System Initialization.637gitlab # [ 4.701320] systemd[1]: Stopped target Swaps.638gitlab # [ 4.703911] systemd[1]: Stopped target Timer Units.639gitlab # [ 4.706752] systemd[1]: dbus.socket: Deactivated successfully.640gitlab # [ 4.709829] systemd[1]: Closed D-Bus System Message Bus Socket.641gitlab # [ 4.712620] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.642gitlab # [ 4.716166] systemd[1]: Stopped Find NixOS closure.643gitlab # [ 4.718659] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio644gitlab # [ 4.723484] systemd[1]: Starting rw-sysroot-nix-store.service...645gitlab # [ 4.725830] systemd[1]: systemd-sysctl.service: Deactivated successfully.646gitlab # [ 4.728841] systemd[1]: Stopped Apply Kernel Variables.647gitlab # [ 4.731198] systemd[1]: systemd-modules-load.service: Deactivated successfully.648gitlab # [ 4.733426] systemd[1]: Stopped Load Kernel Modules.649gitlab # [ 4.735357] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.650gitlab # [ 4.737818] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.651gitlab # [ 4.740293] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.652gitlab # [ 4.742504] systemd[1]: Stopped Create System Files and Directories.653gitlab # [ 4.744532] systemd[1]: Stopped target Local File Systems.654gitlab # [ 4.746423] systemd[1]: Stopped target Preparation for Local File Systems.655gitlab # [ 4.748610] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.656gitlab # [ 4.750830] systemd[1]: Stopped Coldplug All udev Devices.657gitlab # [ 4.752637] systemd[1]: Stopping Rule-based Manager for Device Events and Files...658gitlab # [ 4.755347] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.659gitlab # [ 4.757125] systemd[1]: Stopped Virtual Console Setup.660gitlab # [ 4.758412] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.661gitlab # [ 4.760421] systemd[1]: Finished rw-sysroot-nix-store.service.662gitlab # [ 4.767323] systemd[1]: initrd-cleanup.service: Deactivated successfully.663gitlab # [ 4.771706] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.664gitlab # [ 4.776600] systemd[1]: systemd-udevd.service: Deactivated successfully.665gitlab # [ 4.780284] systemd[1]: Stopped Rule-based Manager for Device Events and Files.666gitlab # [ 4.782227] systemd[1]: systemd-udevd.service: Consumed 1.110s CPU time over 2.187s wall clock time, 25.2M memory peak.667gitlab # [ 4.786913] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.668gitlab # [ 4.788982] systemd[1]: Closed udev Control Socket.669gitlab # [ 4.792459] systemd[1]: Starting Cleanup udev Database...670gitlab # [ 4.793802] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.671gitlab # [ 4.795651] systemd[1]: Stopped Create Static Device Nodes in /dev.672gitlab # [ 4.798355] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.673gitlab # [ 4.800362] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.674gitlab # [ 4.804464] systemd[1]: kmod-static-nodes.service: Deactivated successfully.675gitlab # [ 4.806218] systemd[1]: Stopped Create List of Static Device Nodes.676gitlab # [ 4.816389] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.677gitlab # [ 4.819903] systemd[1]: Finished Cleanup udev Database.678gitlab # [ 4.824683] systemd[1]: Reached target Switch Root.679gitlab # [ 4.827715] systemd[1]: Starting NixOS Activation...680gitlab # [ 4.952598] initrd-nixos-activation-start[565]: booting system configuration /nix/store/h7wd45w3kar8s1z37dm6ggs7yflpylx9-nixos-system-gitlab-test681gitlab # [ 5.008853] initrd-nixos-activation-start[565]: running activation script...682gitlab # [ 5.258863] initrd-nixos-activation-start[588]: setting up /etc...683gitlab # [ 5.389933] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.684gitlab # [ 5.398542] systemd[1]: Finished NixOS Activation.685gitlab # [ 5.409536] systemd[1]: Starting Switch Root...686gitlab # [ 5.452573] systemd[1]: Switching root.687gitlab # [ 6.103021] systemd-journald[151]: Received SIGTERM from PID 1 (systemd).688gitlab # [ 6.223686] NET: Registered PF_VSOCK protocol family689gitlab # [ 6.593208] systemd[1]: systemd 260.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)690gitlab # [ 6.609153] systemd[1]: Detected virtualization kvm.691gitlab # [ 6.612190] systemd[1]: Detected architecture x86-64.692gitlab # [ 6.615359] systemd[1]: Detected first boot.693gitlab # [ 6.619421] systemd[1]: Initializing machine ID from random generator.694gitlab # [ 6.762966] systemd[1]: bpf-restrict-fs: LSM BPF program attached695gitlab # [ 6.828519] systemd[1]: Applying preset policy.696gitlab # [ 6.989510] systemd[1]: Populated /etc with preset unit settings.697gitlab # [ 7.109323] systemd[1]: initrd-switch-root.service: Deactivated successfully.698gitlab # [ 7.111975] systemd[1]: Stopped initrd-switch-root.service.699gitlab # [ 7.115138] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.700gitlab # [ 7.118393] systemd[1]: Created slice Slice /system/getty.701gitlab # [ 7.120551] systemd[1]: Created slice GitLab DevOps Platform Slice.702gitlab # [ 7.122916] systemd[1]: Created slice User and Session Slice.703gitlab # [ 7.124440] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.704gitlab # [ 7.126455] systemd[1]: Started Forward Password Requests to Wall Directory Watch.705gitlab # [ 7.128285] systemd[1]: Expecting device /dev/hvc0...706gitlab # [ 7.129487] systemd[1]: Expecting device /dev/ttyS0...707gitlab # [ 7.130883] systemd[1]: Reached target Local Encrypted Volumes.708gitlab # [ 7.132301] systemd[1]: Stopped target initrd-fs.target.709gitlab # [ 7.133650] systemd[1]: Stopped target initrd-root-fs.target.710gitlab # [ 7.135106] systemd[1]: Stopped target initrd-switch-root.target.711gitlab # [ 7.136644] systemd[1]: Reached target Virtual Machines and Containers.712gitlab # [ 7.138228] systemd[1]: Reached target Path Units.713gitlab # [ 7.139505] systemd[1]: Reached target Remote File Systems.714gitlab # [ 7.140910] systemd[1]: Reached target Slice Units.715gitlab # [ 7.142177] systemd[1]: Reached target Swaps.716gitlab # [ 7.144521] systemd[1]: Listening on Process Core Dump Socket.717gitlab # [ 7.146664] systemd[1]: Listening on Credential Encryption/Decryption.718gitlab # [ 7.150157] systemd[1]: Starting Journal Log Access Socket...719gitlab # [ 7.152381] systemd[1]: Listening on Journal Audit Socket.720gitlab # [ 7.154079] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.721gitlab # [ 7.155894] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki722gitlab # [ 7.158270] systemd[1]: Listening on udev Control Socket.723gitlab # [ 7.162117] systemd[1]: Mounting Huge Pages File System...724gitlab # [ 7.165030] systemd[1]: Mounting POSIX Message Queue File System...725gitlab # [ 7.168403] systemd[1]: Mounting Kernel Debug File System...726gitlab # [ 7.180941] systemd[1]: Mounting Kernel Trace File System...727gitlab # [ 7.184881] systemd[1]: Starting Create List of Static Device Nodes...728gitlab # [ 7.186895] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio729gitlab # [ 7.193062] systemd[1]: Starting Load Kernel Module configfs...730gitlab # [ 7.194637] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm731gitlab # [ 7.197039] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore732gitlab # [ 7.199680] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse733gitlab # [ 7.205993] systemd[1]: Mounting FUSE Control File System...734gitlab # [ 7.219894] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67735gitlab # [ 7.229106] systemd[1]: Starting Journal Service...736gitlab # [ 7.236157] systemd[1]: Starting Load Kernel Modules...737gitlab # [ 7.244536] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...738gitlab # [ 7.252826] systemd[1]: Starting Remount Root and Kernel File Systems...739gitlab # [ 7.256191] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki740gitlab # [ 7.264451] systemd-journald[782]: Collecting audit messages is enabled.741gitlab # [ 7.272309] systemd[1]: Starting Coldplug All udev Devices...742gitlab # [ 7.279073] systemd[1]: Listening on Journal Log Access Socket.743gitlab # [ 7.282984] systemd[1]: Mounted Huge Pages File System.744gitlab # [ 7.284438] EXT4-fs (vda): re-mounted 0e27d305-6fc2-4f9b-9a67-67d6106ff2f6.745gitlab # [ 7.284643] systemd[1]: Mounted POSIX Message Queue File System.746gitlab # [ 7.028308] systemd[1]: Queue[ 7.285815] loop: module loaded747gitlab # d start job for [ 7.287347] systemd[1]: Mounted Kernel Debug File System.748gitlab # default target Multi-User System.749gitlab # [ 7.290609] systemd[1]: Started Journal Service.750gitlab # [ 7.032083] systemd[1]: Unnecessary job was removed for /dev/vdb.751gitlab # [ 7.034486] systemd[1]: systemd-journald.service: Deactivated successfully.752gitlab # [ 7.036545] systemd-modules-load[784]: Using 3 probe threads753gitlab # [ 7.038285] systemd-modules-load[784]: Inserted module 'tls'754gitlab # [ 7.040078] systemd-modules-load[784]: Inserted module 'loop'755gitlab # [ 7.041884] systemd[1]: Mounted Kernel Trace File System.756gitlab # [ 7.043742] systemd[1]: Finished Create List of Static Device Nodes.757gitlab # [ 7.045515] systemd[1]: modprobe@configfs.service: Deactivated successfully.758gitlab # [ 7.048593] systemd[1]: Finished Load Kernel Module configfs.759gitlab # [ 7.050279] systemd[1]: Mounted FUSE Control File System.760gitlab # [ 7.051908] systemd[1]: Finished Load Kernel Modules.761gitlab # [ 7.053286] systemd[1]: Mounting Kernel Configuration File System...762gitlab # [ 7.054870] systemd[1]: Starting Firewall...763gitlab # [ 7.056353] systemd-oomd[785]: No swap; memory pressure usage will be degraded764gitlab # [ 7.058685] systemd[1]: Starting Apply Kernel Variables...765gitlab # [ 7.060304] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...766gitlab # [ 7.062348] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.767gitlab # [ 7.064275] systemd[1]: Finished Remount Root and Kernel File Systems.768gitlab # [ 7.071603] systemd[1]: Mounted Kernel Configuration File System.769gitlab # [ 7.078812] systemd[1]: Starting Flush Journal to Persistent Storage...770gitlab # [ 7.080596] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore771gitlab # [ 7.087698] systemd[1]: Starting Load/Save OS Random Seed...772gitlab # [ 7.089621] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki773gitlab # [ 7.091717] systemd[1]: Finished Apply Kernel Variables.774gitlab # [ 7.354392] systemd-journald[782]: Received client request to flush runtime journal.775gitlab # [ 7.159132] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.776gitlab # [ 7.162057] systemd[1]: Starting Create Static Device Nodes in /dev...777gitlab # [ 7.164649] systemd[1]: Finished Load/Save OS Random Seed.778gitlab # [ 7.166376] systemd[1]: Reached target First Boot Complete.779gitlab # [ 7.167980] systemd[1]: Finished Create Static Device Nodes in /dev.780gitlab # [ 7.169806] systemd[1]: Reached target Preparation for Local File Systems.781gitlab # [ 7.171510] systemd[1]: Starting Rule-based Manager for Device Events and Files...782gitlab # [ 7.173501] systemd[1]: Finished Flush Journal to Persistent Storage.783gitlab # [ 7.175409] systemd-udevd[821]: Using default interface naming scheme 'v260'.784gitlab # [ 7.214497] systemd[1]: Started Rule-based Manager for Device Events and Files.785gitlab # [ 7.267330] systemd[1]: Finished Coldplug All udev Devices.786gitlab # [ 7.340252] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse787gitlab # [ 7.346085] systemd[1]: Finished Firewall.788gitlab # [ 7.367129] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.789gitlab # [ 7.392431] (udev-worker)[882]: Network interface NamePolicy= disabled on kernel command line.790gitlab # [ 7.400079] (udev-worker)[888]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.791gitlab # [ 7.403728] (udev-worker)[888]: Network interface NamePolicy= disabled on kernel command line.792gitlab # [ 7.417824] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.793gitlab # [ 7.434618] systemd[1]: Condition check resulted in Virtio network device being skipped.794gitlab # [ 7.436764] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore795gitlab # [ 7.439445] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67796gitlab # [ 7.443267] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore797gitlab # [ 7.445998] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki798gitlab # [ 7.448524] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki799gitlab # [ 7.725494] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0800gitlab # [ 7.729861] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console801gitlab # [ 7.742438] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3802gitlab # [ 7.746318] Console: switching to colour dummy device 80x25803gitlab # [ 7.749189] [drm] Found bochs VGA, ID 0xb0c5.804gitlab # [ 7.749191] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.805gitlab # [ 7.749454] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD806gitlab # [ 7.749620] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic807gitlab # [ 7.749627] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0808gitlab # [ 7.756727] ACPI: button: Power Button [PWRF]809gitlab # [ 7.757705] fbcon: bochs-drmdrmfb (fb0) is primary device810gitlab # [ 7.764257] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5811gitlab # [ 7.765013] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4812gitlab # [ 7.767951] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input6813gitlab # [ 7.769121] Console: switching to colour frame buffer device 160x50814gitlab # [ 7.778797] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device815gitlab # [ 7.804130] rtc_cmos 00:05: RTC can wake from S4816gitlab # [ 7.805530] Floppy drive(s): fd0 is 2.88M AMI BIOS817gitlab # [ 7.806770] rtc_cmos 00:05: registered as rtc0818gitlab # [ 7.807875] rtc_cmos 00:05: setting system clock to 2026-08-11T09:39:26 UTC (1786441166)819gitlab # [ 7.811685] parport_pc 00:03: reported by Plug and Play ACPI820gitlab # [ 7.813701] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs821gitlab # [ 7.814786] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]822gitlab # [ 7.817698] mousedev: PS/2 mouse device common for all mice823gitlab # [ 7.819348] FDC 0 is a S82078B824gitlab # [ 7.628537] systemd[1]: Starting Virtual Console Setup...825gitlab # [ 7.651145] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.826gitlab # [ 7.655421] systemd[1]: Stopped Virtual Console Setup.827gitlab # [ 7.921620] ppdev: user-space parallel port driver828gitlab # [ 7.663321] systemd[1]: Starting Virtual Console Setup...829gitlab # [ 7.967752] erofs (device vdb): failed to read inode meta block (nid: 109364224): -4830gitlab # [ 7.712323] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.831gitlab # [ 7.715071] systemd[1]: Stopped Virtual Console Setup.832gitlab # [ 7.723238] systemd[1]: Starting Virtual Console Setup...833gitlab # [ 8.045228] kvm_amd: TSC scaling supported834gitlab # [ 8.046382] kvm_amd: Nested Virtualization enabled835gitlab # [ 8.047644] kvm_amd: Nested Paging enabled836gitlab # [ 8.048539] kvm_amd: LBR virtualization supported837gitlab # [ 8.049709] kvm_amd: Virtual VMLOAD VMSAVE supported838gitlab # [ 8.050943] kvm_amd: Virtual GIF supported839gitlab # [ 8.052012] kvm_amd: Virtual NMI enabled840gitlab # [ 7.843687] systemd-vconsole-setup[956]: Configuration of first virtual console was skipped, ignoring remaining ones.841gitlab # [ 7.847074] s[ 8.106838] EDAC MC: Ver: 3.0.0842gitlab # ystemd[1]: Finished Virtual Console Setup.843gitlab # [ 7.852448] systemd[1]: Mounting /run/wrappers...844gitlab # [ 7.878891] systemd[1]: Mounted /run/wrappers.845gitlab # [ 7.880423] systemd[1]: Reached target Local File Systems.846gitlab # [ 7.881873] systemd[1]: Listening on Boot Loader Control Service Socket.847gitlab # [ 7.883653] systemd[1]: Starting register-nix-paths.service...848gitlab # [ 7.885289] systemd[1]: Starting Create SUID/SGID Wrappers...849gitlab # [ 7.887003] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.850gitlab # [ 7.889487] systemd[1]: Starting Save Transient machine-id to Disk...851gitlab # [ 7.891371] systemd[1]: Starting Create System Files and Directories...852gitlab # [ 7.924455] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.853gitlab # [ 7.928752] systemd[1]: Finished Save Transient machine-id to Disk.854gitlab # [ 7.931945] systemd[1]: Finished Create System Files and Directories.855gitlab # [ 7.936214] systemd[1]: Starting Rebuild Journal Catalog...856gitlab # [ 7.938981] systemd[1]: Starting Record System Boot/Shutdown in UTMP...857gitlab # [ 7.955292] systemd[1]: Finished Record System Boot/Shutdown in UTMP.858gitlab # [ 7.971645] systemd[1]: Finished Rebuild Journal Catalog.859gitlab # [ 7.974379] systemd[1]: Starting Update is Completed...860gitlab # [ 7.989841] systemd[1]: Finished Update is Completed.861gitlab # [ 8.040293] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.862gitlab # [ 8.042539] systemd[1]: Finished Create SUID/SGID Wrappers.863gitlab # [ 8.044260] systemd[1]: suid-sgid-wrappers.service: Consumed 123ms CPU time over 155ms wall clock time, 4.6M memory peak, 1.1M read from disk.864gitlab # [ 8.282673] systemd[1]: Finished register-nix-paths.service.865gitlab # [ 8.287157] systemd[1]: Reached target System Initialization.866gitlab # [ 8.291468] systemd[1]: Started Discard unused filesystem blocks once a week.867gitlab # [ 8.296429] systemd[1]: Started logrotate.timer.868gitlab # [ 8.300147] systemd[1]: Started Daily Cleanup of Temporary Directories.869gitlab # [ 8.304952] systemd[1]: Reached target Timer Units.870gitlab # [ 8.308739] systemd[1]: Listening on D-Bus System Message Bus Socket.871gitlab # [ 8.313339] systemd[1]: Listening on Nix Daemon Socket.872gitlab # [ 8.317349] systemd[1]: Starting nixbot CI service socket...873gitlab # [ 8.321604] systemd[1]: Listening on Hostname Service Socket.874gitlab # [ 8.325939] systemd[1]: Starting D-Bus System Message Bus...875gitlab # [ 8.330129] systemd[1]: Listening on nixbot CI service socket.876gitlab # [ 8.334272] systemd[1]: Reached target Socket Units.877gitlab # [ 8.386560] dbus-broker-launch[1046]: Looking up NSS user entry for 'systemd-timesync'...878gitlab # [ 8.392850] dbus-broker-launch[1046]: NSS returned no entry for 'systemd-timesync'879gitlab # [ 8.397895] dbus-broker-launch[1046]: Invalid user-name in /nix/store/89zj9nmrajvcy9c3c08wv0ir9ww7lgmq-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"880gitlab # [ 8.407791] systemd[1]: Started D-Bus System Message Bus.881gitlab # [ 8.433678] dbus-broker-launch[1046]: Ready882gitlab # [ 8.438762] systemd[1]: Reached target Basic System.883gitlab # [ 8.442852] systemd[1]: Started backdoor.service.884gitlab # [ 8.446624] systemd[1]: Starting gitlab-config.service...885gitlab # [ 8.450450] systemd[1]: Starting Import lastlog data into lastlog2 database...886gitlab # [ 8.456780] systemd[1]: Starting Logrotate configuration check...887gitlab # [ 8.466855] systemd[1]: Starting Name Service Cache Daemon (nsncd)...888gitlab # [ 8.473547] systemd[1]: Starting Post-Boot Actions...889gitlab # [ 8.483190] systemd[1]: Started Reset console on configuration changes.890gitlab # [ 8.489206] logrotate[1051]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.891gitlab # connecting to host...892gitlab # [ 8.497406] logrotate[1051]: reading config file /nix/store/sn4bd2nqi3yg4r51djm9i2rmfgbwvmhb-logrotate.conf893gitlab # [ 8.500213] logrotate[1051]: note: 'monthly' overrides previously specified 'weekly'894gitlab # [ 8.502126] logrotate[1051]: Reading state from file: /var/lib/logrotate.status895gitlab: Guest shell says: b'Spawning backdoor root shell...\n'896gitlab # [ 8.508292] logrotate[1051]: state file /var/lib/logrotate.status does not exist897gitlab: connected to guest root shell898gitlab # [ 8.510196] logrotate[1051]: Allocating hash table for state file, size 64 entries899gitlab: (connecting took 9.38 seconds)900gitlab # [ 8.512169] logrotate[1051]: Handling 4 logs901gitlab: (finished: waiting for the VM to finish booting, in 9.38 seconds)902gitlab # [ 8.513287] logrotate[1051]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed903gitlab # [ 8.517494] logrotate[1051]: considering log /var/log/btmp904gitlab # [ 8.518836] logrotate[1051]: Creating new state905gitlab # [ 8.520060] logrotate[1051]: Now: 2026-08-11 09:39906gitlab # [ 8.521367] logrotate[1051]: Last rotated at 2026-08-11 09:00907gitlab # [ 8.523182] logrotate[1051]: log does not need rotating (log has already been rotated)908gitlab # [ 8.525129] logrotate[1051]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed909gitlab # [ 8.528879] logrotate[1051]: considering log /var/log/wtmp910gitlab # [ 8.530273] logrotate[1051]: Creating new state911gitlab # [ 8.531976] logrotate[1051]: Now: 2026-08-11 09:39912gitlab # [ 8.533502] logrotate[1051]: Last rotated at 2026-08-11 09:00913gitlab # [ 8.535192] logrotate[1051]: log does not need rotating (log has already been rotated)914gitlab # [ 8.537281] logrotate[1051]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed915gitlab # [ 8.540748] logrotate[1051]: switching euid from 0 to 165 and egid from 0 to 165 (pid 1051)916gitlab # [ 8.542743] logrotate[1051]: considering log /var/gitlab/state/log/*.log917gitlab # [ 8.544521] logrotate[1051]: log /var/gitlab/state/log/*.log does not exist -- skipping918gitlab # [ 8.546577] logrotate[1051]: Creating new state919gitlab # [ 8.548628] logrotate[1051]: switching euid from 165 to 0 and egid from 165 to 0 (pid 1051)920gitlab # [ 8.550706] logrotate[1051]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed921gitlab # [ 8.553828] logrotate[1051]: switching euid from 0 to 60 and egid from 0 to 60 (pid 1051)922gitlab # [ 8.555814] logrotate[1051]: considering log /var/log/nginx/*.log923gitlab # [ 8.557360] logrotate[1051]: log /var/log/nginx/*.log does not exist -- skipping924gitlab # [ 8.559190] logrotate[1051]: Creating new state925gitlab # [ 8.560405] logrotate[1051]: switching euid from 60 to 0 and egid from 60 to 0 (pid 1051)926gitlab # [ 8.562838] nsncd[1052]: Aug 11 09:39:27.474 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"927gitlab # [ 8.566583] systemd[1]: Starting resolvconf update...928gitlab # [ 8.568180] systemd[1]: Finished Logrotate configuration check.929gitlab # [ 8.570060] systemd[1]: Finished Post-Boot Actions.930gitlab # [ 8.571657] systemd[1]: Finished Import lastlog data into lastlog2 database.931gitlab # [ 8.573838] systemd[1]: Started Name Service Cache Daemon (nsncd).932gitlab # [ 8.575787] systemd[1]: Reached target Host and Network Name Lookups.933gitlab # [ 8.578995] systemd[1]: Reached target User and Group Name Lookups.934gitlab # [ 8.580983] systemd[1]: Starting User Login Management...935gitlab # [ 8.582778] systemd[1]: Stopped target Host and Network Name Lookups.936gitlab # [ 8.583923] systemd[1]: Stopping Host and Network Name Lookups...937gitlab # [ 8.585578] systemd[1]: Stopped target User and Group Name Lookups.938gitlab # [ 8.586937] systemd[1]: Stopping User and Group Name Lookups...939gitlab # [ 8.588182] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...940gitlab # [ 8.589345] systemd[1]: nscd.service: Deactivated successfully.941gitlab # [ 8.590259] systemd[1]: Stopped Name Service Cache Daemon (nsncd).942gitlab # [ 8.591552] systemd[1]: nscd.service: Consumed 22ms CPU time over 105ms wall clock time, 8M memory peak, 5.7M read from disk.943gitlab # [ 8.592882] systemd[1]: Starting Name Service Cache Daemon (nsncd)...944gitlab # [ 8.604487] systemd-logind[1095]: New seat seat0.945gitlab # [ 8.611098] systemd-logind[1095]: Watching system buttons on /dev/input/event2 (Power Button)946gitlab # [ 8.613364] systemd-logind[1095]: Watching system buttons on /dev/input/event5 (QEMU Virtio Keyboard)947gitlab # [ 8.616814] systemd-logind[1095]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)948gitlab # [ 8.619700] nsncd[1139]: Aug 11 09:39:27.566 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"949gitlab # [ 8.623461] systemd[1]: Started User Login Management.950gitlab # [ 8.626810] systemd[1]: Starting linger-users.service...951gitlab # [ 8.631117] systemd[1]: Started Name Service Cache Daemon (nsncd).952gitlab # [ 8.632319] systemd[1]: Reached target Host and Network Name Lookups.953gitlab # [ 8.633288] systemd[1]: Reached target User and Group Name Lookups.954gitlab # [ 8.637161] systemd[1]: Finished resolvconf update.955gitlab # [ 8.638571] systemd[1]: Reached target Preparation for Network.956gitlab # [ 8.641324] systemd[1]: Starting DHCP Client...957gitlab # [ 8.642957] systemd[1]: Starting Address configuration of eth1...958gitlab # [ 8.646708] systemd[1]: Starting Extra networking commands....959gitlab # [ 8.648320] systemd[1]: linger-users.service: Deactivated successfully.960gitlab # [ 8.650122] systemd[1]: Finished linger-users.service.961gitlab # [ 8.679767] network-addresses-eth1-start[1163]: adding address 192.168.1.1/24... done962gitlab # [ 8.684275] network-addresses-eth1-start[1163]: adding address 2001:db8:1::1/64... done963gitlab # [ 8.690155] systemd[1]: Finished Address configuration of eth1.964gitlab # [ 8.715696] systemd[1]: Finished Extra networking commands..965gitlab # [ 8.717265] systemd[1]: Reached target Network.966gitlab # [ 8.719664] systemd[1]: Starting gitlab-workhorse.service...967gitlab # [ 8.723256] systemd[1]: Starting Nginx Web Server...968gitlab # [ 8.728099] systemd[1]: Starting PostgreSQL Server...969gitlab # [ 8.731763] dhcpcd[1176]: dhcpcd-10.3.2 starting970gitlab # [ 8.733499] systemd[1]: Starting Redis Server - redis-gitlab...971gitlab # [ 8.735343] systemd[1]: Starting Permit User Sessions...972gitlab # [ 8.739136] dhcpcd[1226]: dev: loaded udev973gitlab # [ 9.002882] 8021q: 802.1Q VLAN Support v1.8974gitlab # [ 9.005237] 8021q: adding VLAN 0 to HW filter on device eth1975gitlab # [ 8.758350] systemd[1]: Finished Permit User Sessions.976gitlab # [ 8.767515] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.977gitlab # [ 8.770545] systemd[1]: Started Getty on tty1.978gitlab # [ 8.772610] systemd[1]: Reached target Login Prompts.979gitlab # [ 9.118705] cfg80211: Loading compiled-in X.509 certificates for regulatory database980gitlab # [ 9.126053] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'981gitlab # [ 9.127903] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'982gitlab # [ 9.131081] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2983gitlab # [ 9.133051] cfg80211: failed to load regulatory.db984gitlab # [ 8.881573] nginx-pre-start[1245]: nginx: the configuration file /nix/store/nlpb2pnbsk0921apkv5yml2qxbm30d7w-nginx.conf syntax is ok985gitlab # [ 8.884074] nginx-pre-start[1245]: nginx: configuration file /nix/store/nlpb2pnbsk0921apkv5yml2qxbm30d7w-nginx.conf test is successful986gitlab # [ 8.889158] systemd[1]: Started Nginx Web Server.987gitlab # [ 8.894518] redis-server[1247]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.988gitlab # [ 8.899096] redis-server[1247]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo989gitlab # [ 8.900867] redis-server[1247]: Redis version=8.8.0, bits=64, commit=00000000, modified=0, pid=1247, just started990gitlab # [ 8.901946] redis-server[1[ 9.162488] 8021q: adding VLAN 0 to HW filter on device eth0991gitlab # 247]: Configuration loaded992gitlab # [ 8.905990] redis[1247]: monotonic clock: POSIX clock_gettime993gitlab # [ 8.907199] systemd[1]: Started Redis Server - redis-gitlab.994gitlab # [ 8.908162] postgresql-pre-start[1249]: The files belonging to this database system will be owned by user "postgres".995gitlab # [ 8.909143] postgresql-pre-start[1249]: This user must also own the server process.996gitlab # [ 8.910241] redis[1247]: Running mode=standalone, port=0.997gitlab # [ 8.913139] redis[1247]: Server initialized998gitlab # [ 8.913950] postgresql-pre-start[1249]: The database cluster will be initialized with locale "en_US.UTF-8".999gitlab # [ 8.915589] postgresql-pre-start[1249]: The default database encoding has accordingly been set to "UTF8".1000gitlab # [ 8.916893] postgresql-pre-start[1249]: The default text search configuration will be set to "english".1001gitlab # [ 8.918148] postgresql-pre-start[1249]: Data page checksums are disabled.1002gitlab # [ 8.919102] postgresql-pre-start[1249]: fixing permissions on existing directory /var/lib/postgresql/17 ... ok1003gitlab # [ 8.919883] postgresql-pre-start[1249]: creating subdirectories ... ok1004gitlab # [ 8.921044] postgresql-pre-start[1249]: selecting dynamic shared memory implementation ... posix1005gitlab # [ 8.921941] redis[1247]: Ready to accept connections unix1006gitlab # [ 8.923291] redis[1247]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1007gitlab # [ 8.924164] dhcpcd[1226]: eth0: waiting for carrier1008gitlab # [ 8.924775] dhcpcd[1226]: eth0: carrier acquired1009gitlab # [ 8.925935] dhcpcd[1226]: DUID 00:01:00:01:32:0d:aa:4f:52:54:00:12:34:561010gitlab # [ 8.927234] dhcpcd[1226]: eth0: IAID 00:12:34:561011gitlab # [ 8.928157] dhcpcd[1226]: eth0: adding address fe80::5054:ff:fe12:34561012gitlab # [ 8.946364] postgresql-pre-start[1249]: selecting default "max_connections" ... 1001013gitlab # [ 8.986879] postgresql-pre-start[1249]: selecting default "shared_buffers" ... 128MB1014gitlab # [ 9.198317] dhcpcd[1226]: eth0: soliciting a DHCP lease1015gitlab # [ 9.475147] NET: Registered PF_PACKET protocol family1016gitlab # [ 9.224248] dhcpcd[1226]: eth0: offered 10.0.2.15 from 10.0.2.21017gitlab # [ 9.230426] dhcpcd[1226]: eth0: probing address 10.0.2.15/241018gitlab # [ 9.244307] systemd[1]: Started gitlab-workhorse.service.1019gitlab # [ 9.360679] postgresql-pre-start[1249]: selecting default time zone ... UTC1020gitlab # [ 9.365910] postgresql-pre-start[1249]: creating configuration files ... ok1021gitlab # [ 9.488989] gitlab-workhorse[1283]: time="2026-08-11T09:39:28Z" level=info msg=Starting build_time=19700101.000000 version=18.11.41022gitlab # [ 9.490821] gitlab-workhorse[1283]: time="2026-08-11T09:39:28Z" level=info msg="Using redis/go-redis"1023gitlab # [ 9.493625] gitlab-workhorse[1283]: time="2026-08-11T09:39:28Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1024gitlab # [ 9.553105] postgresql-pre-start[1249]: running bootstrap script ... ok1025gitlab # [ 10.018795] postgresql-pre-start[1249]: performing post-bootstrap initialization ... ok1026gitlab # [ 10.370358] postgresql-pre-start[1249]: syncing data to disk ... ok1027gitlab # [ 10.372231] postgresql-pre-start[1249]: initdb: warning: enabling "trust" authentication for local connections1028gitlab # [ 10.373855] postgresql-pre-start[1249]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1029gitlab # [ 10.375486] postgresql-pre-start[1249]: Success. You can now start the database server using:1030gitlab # [ 10.377238] postgresql-pre-start[1249]: pg_ctl -D /var/lib/postgresql/17 -l logfile start1031gitlab # [ 10.498271] postgres[1309]: [1309] LOG: starting PostgreSQL 17.10 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1032gitlab # [ 10.505950] postgres[1309]: [1309] LOG: listening on IPv6 address "::1", port 54321033gitlab # [ 10.511127] postgres[1309]: [1309] LOG: listening on IPv4 address "127.0.0.1", port 54321034gitlab # [ 10.517478] postgres[1309]: [1309] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1035gitlab # [ 10.523674] postgres[1315]: [1315] LOG: database system was shut down at 2026-08-11 09:39:28 GMT1036gitlab # [ 10.532245] postgres[1309]: [1309] LOG: database system is ready to accept connections1037gitlab # [ 10.539350] systemd[1]: Started PostgreSQL Server.1038gitlab # [ 10.542816] systemd[1]: Starting PostgreSQL Setup Scripts...1039gitlab # [ 10.642541] dhcpcd[1226]: eth0: soliciting an IPv6 router1040gitlab # [ 10.645748] dhcpcd[1226]: eth0: Router Advertisement from fe80::21041gitlab # [ 10.646994] dhcpcd[1226]: eth0: adding address fec0::5054:ff:fe12:3456/641042gitlab # [ 10.649053] dhcpcd[1226]: eth0: adding route to fec0::/641043gitlab # [ 10.651221] dhcpcd[1226]: eth0: adding default route via fe80::21044gitlab # [ 10.733922] postgresql-setup-start[1326]: CREATE DATABASE1045gitlab # [ 10.763347] postgresql-setup-start[1340]: CREATE ROLE1046gitlab # [ 10.771724] postgresql-setup-start[1342]: ALTER DATABASE1047gitlab # [ 10.797870] postgresql-setup-start[1347]: CREATE ROLE1048gitlab # [ 10.803502] systemd[1]: Finished PostgreSQL Setup Scripts.1049gitlab # [ 10.806279] systemd[1]: Reached target PostgreSQL.1050gitlab # [ 10.808546] systemd[1]: Starting gitlab-postgresql.service...1051gitlab # [ 10.926204] gitlab-postgresql-start[1359]: CREATE DATABASE1052gitlab # [ 10.963802] gitlab-postgresql-start[1364]: CREATE EXTENSION1053gitlab # [ 10.978496] 119c5p75zqwmpdrsjsd5cszxwrq2hgfq-gitlab-config[1354]: mkdir -p /var/gitlab/state/home/.ssh: OK1054gitlab # [ 10.981199] 119c5p75zqwmpdrsjsd5cszxwrq2hgfq-gitlab-config[1354]: chmod 700 /var/gitlab/state/home/.ssh: OK1055gitlab # [ 11.032263] gitlab-postgresql-start[1366]: CREATE EXTENSION1056gitlab # [ 11.037204] systemd[1]: Finished gitlab-postgresql.service.1057gitlab # [ 11.040852] systemd[1]: Finished gitlab-config.service.1058gitlab # [ 11.044467] systemd[1]: Started gitaly.service.1059gitlab # [ 11.047770] systemd[1]: Starting gitlab-db-config.service...1060gitlab # [ 11.640942] gitaly[1381]: time="2026-08-11T09:39:30.592Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/2wcq0nlg508fs5wq7jnpg1lw2pib950g-gitaly.toml' and fix the errors that are printed." pid=13811061gitlab # [ 11.642775] gitaly[1381]: time="2026-08-11T09:39:30.592Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=13811062gitlab # [ 11.646235] gitaly[1381]: time="2026-08-11T09:39:30.592Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=13811063gitlab # [ 11.650250] gitaly[1381]: time="2026-08-11T09:39:30.593Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=13811064gitlab # [ 11.653127] gitaly[1381]: time="2026-08-11T09:39:30.593Z" level=info msg="Starting Gitaly" pid=1381 version=18.11.41065gitlab # [ 11.873928] gitaly[1381]: time="2026-08-11T09:39:30.825Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=231 pid=13811066gitlab # [ 11.875183] gitaly[1381]: time="2026-08-11T09:39:30.825Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=13811067gitlab # [ 11.881251] gitaly[1381]: time="2026-08-11T09:39:30.832Z" level=info msg="finished initializing command factory" duration_ms=7 pid=13811068gitlab # [ 11.882507] gitaly[1381]: time="2026-08-11T09:39:30.832Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-1381/git-exec-27923417.d/git pid=13811069gitlab # [ 11.892881] gitaly[1381]: time="2026-08-11T09:39:30.844Z" level=info msg="finished detecting git version" duration_ms=11 pid=13811070gitlab # [ 11.894223] gitaly[1381]: time="2026-08-11T09:39:30.844Z" level=info msg="using Git version" pid=1381 version=2.53.g1071gitlab # [ 11.900511] gitaly[1381]: time="2026-08-11T09:39:30.852Z" level=info msg="clearing disk cache object folder" pid=1381 storage=default1072gitlab # [ 11.902347] gitaly[1381]: time="2026-08-11T09:39:30.852Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2120863586 pid=1381 storage=default1073gitlab # [ 11.903289] gitaly[1381]: time="2026-08-11T09:39:30.852Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2120863586 pid=1381 storage=default1074gitlab # [ 11.904238] gitaly[1381]: time="2026-08-11T09:39:30.852Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=13811075gitlab # [ 11.905073] gitaly[1381]: time="2026-08-11T09:39:30.852Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=13811076gitlab # [ 11.905943] gitaly[1381]: time="2026-08-11T09:39:30.852Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2120863586 clear_duration_ms=0 pid=1381 storage=default1077gitlab # [ 11.974237] gitaly[1381]: time="2026-08-11T09:39:30.925Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=13811078gitlab # [ 11.976242] gitaly[1381]: time="2026-08-11T09:39:30.925Z" level=info msg="counting repositories" pid=13811079gitlab # [ 11.977494] gitaly[1381]: time="2026-08-11T09:39:30.927Z" level=info msg="starting to count repositories" pid=1381 storage_path=/var/gitlab/state/repositories1080gitlab # [ 11.985681] gitaly[1381]: time="2026-08-11T09:39:30.937Z" level=info msg="finished tempdir cleaner walk" pid=1381 storage=default time_ms=111081gitlab # [ 11.986984] gitaly[1381]: time="2026-08-11T09:39:30.937Z" level=info msg="completed counting repositories" counting_duration_ms=9 pid=1381 storage_path=/var/gitlab/state/repositories1082gitlab # [ 11.988057] gitaly[1381]: time="2026-08-11T09:39:30.937Z" level=info msg="completed counting all repositories" counting_duration=9 pid=13811083gitlab # [ 11.988791] gitaly[1381]: time="2026-08-11T09:39:30.937Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=1381 schema=unix1084gitlab # [ 11.990381] gitaly[1381]: time="2026-08-11T09:39:30.938Z" level=info msg="listening at address" address=/run/gitaly/gitaly-1381/sock.d/intern pid=1381 schema=unix1085gitlab # [ 12.006061] gitaly[1381]: time="2026-08-11T09:39:30.957Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=13811086gitlab # [ 12.007212] gitaly[1381]: time="2026-08-11T09:39:30.957Z" level=info msg="Started Gitaly" duration_ms=364 pid=13811087gitlab # [ 12.008078] gitaly[1381]: time="2026-08-11T09:39:30.958Z" level=info msg="maintenance: daily scheduled" pid=1381 scheduled="2026-08-11 12:00:00 +0000 UTC"1088gitlab # [ 12.216742] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1384]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1089gitlab # [ 12.219207] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1384]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1090gitlab # [ 12.253156] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1384]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1091gitlab # [ 13.917720] gitaly[1381]: time="2026-08-11T09:39:32.868Z" level=info msg="License database preloaded" duration_ms=2245 pid=13811092gitlab # [ 14.221915] dhcpcd[1226]: eth0: leased 10.0.2.15 for 86400 seconds1093gitlab # [ 14.225524] dhcpcd[1226]: eth0: adding route to 10.0.2.0/241094gitlab # [ 14.228149] dhcpcd[1226]: eth0: adding default route via 10.0.2.21095gitlab # [ 14.331124] systemd[1]: Started DHCP Client.1096gitlab # [ 14.335973] systemd[1]: Reached target Network is Online.1097gitlab # [ 43.878314] postgres[1750]: [1750] ERROR: relation "feature_gates" does not exist at character 5231098gitlab # [ 43.880885] postgres[1750]: [1750] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1099gitlab # [ 43.882652] postgres[1750]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1100gitlab # [ 43.885912] postgres[1750]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1101gitlab # [ 43.889230] postgres[1750]: attidentity AS identity,1102gitlab # [ 43.891896] postgres[1750]: attgenerated as attgenerated1103gitlab # [ 43.894511] postgres[1750]: FROM pg_attribute a1104gitlab # [ 43.896850] postgres[1750]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1105gitlab # [ 43.899622] postgres[1750]: LEFT JOIN pg_type t ON a.atttypid = t.oid1106gitlab # [ 43.902305] postgres[1750]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1107gitlab # [ 43.905249] postgres[1750]: WHERE a.attrelid = '"feature_gates"'::regclass1108gitlab # [ 43.907930] postgres[1750]: AND a.attnum > 0 AND NOT a.attisdropped1109gitlab # [ 43.910596] postgres[1750]: ORDER BY a.attnum1110gitlab # [ 43.912886] postgres[1750]:1111gitlab # [ 44.165676] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1384]: W, [2026-08-11T09:40:03.116590 #1384] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1112gitlab # [ 49.573424] gitlab-workhorse[1283]: time="2026-08-11T09:40:08Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1113gitlab # [ 50.386278] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1815]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1114gitlab # [ 50.389896] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1815]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1115gitlab # [ 59.583847] gitlab-workhorse[1283]: time="2026-08-11T09:40:18Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1116gitlab # [ 68.434655] postgres[1890]: [1890] ERROR: relation "table_without_models" does not exist1117gitlab # [ 68.439729] postgres[1890]: [1890] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1118gitlab # [ 69.585479] gitlab-workhorse[1283]: time="2026-08-11T09:40:28Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1119gitlab # [ 79.594371] gitlab-workhorse[1283]: time="2026-08-11T09:40:38Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1120gitlab # [ 84.966289] systemd[1]: Finished gitlab-db-config.service.1121gitlab # [ 84.975292] systemd[1]: Started gitlab-sidekiq.service.1122gitlab # [ 84.982612] systemd[1]: Starting gitlab.service...1123gitlab # [ 85.360832] bundle[2111]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1124gitlab # [ 85.362909] bundle[2111]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1125gitlab # [ 85.364663] bundle[2111]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1126gitlab # [ 88.359685] sidekiq-cluster[2110]: {"severity":"INFO","time":"2026-08-11T09:40:47.292Z","message":"Starting cluster with 1 processes"}1127gitlab # [ 88.700574] bundle[2111]: {"timestamp":"2026-08-11T09:40:47.625Z","pid":2111,"message":"* Enabling systemd notification integration"}1128gitlab # [ 88.702432] bundle[2111]: {"timestamp":"2026-08-11T09:40:47.650Z","pid":2111,"message":"Puma starting in cluster mode..."}1129gitlab # [ 88.704133] bundle[2111]: {"timestamp":"2026-08-11T09:40:47.650Z","pid":2111,"message":"* Puma version: 7.2.0 (\"On The Corner\")"}1130gitlab # [ 88.705714] bundle[2111]: {"timestamp":"2026-08-11T09:40:47.650Z","pid":2111,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1131gitlab # [ 88.707290] bundle[2111]: {"timestamp":"2026-08-11T09:40:47.650Z","pid":2111,"message":"* Min threads: 0"}1132gitlab # [ 88.708991] bundle[2111]: {"timestamp":"2026-08-11T09:40:47.650Z","pid":2111,"message":"* Max threads: 4"}1133gitlab # [ 88.710633] bundle[2111]: {"timestamp":"2026-08-11T09:40:47.651Z","pid":2111,"message":"* Environment: production"}1134gitlab # [ 88.712300] bundle[2111]: {"timestamp":"2026-08-11T09:40:47.651Z","pid":2111,"message":"* Master PID: 2111"}1135gitlab # [ 88.713691] bundle[2111]: {"timestamp":"2026-08-11T09:40:47.651Z","pid":2111,"message":"* Workers: 2"}1136gitlab # [ 88.715293] bundle[2111]: {"timestamp":"2026-08-11T09:40:47.651Z","pid":2111,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1137gitlab # [ 88.717106] bundle[2111]: {"timestamp":"2026-08-11T09:40:47.651Z","pid":2111,"message":"* Preloading application"}1138gitlab # [ 89.605480] gitlab-workhorse[1283]: time="2026-08-11T09:40:48Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1139gitlab # [ 99.616152] gitlab-workhorse[1283]: time="2026-08-11T09:40:58Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1140gitlab # [ 109.617823] gitlab-workhorse[1283]: time="2026-08-11T09:41:08Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1141gitlab # [ 114.906630] bundle[2111]: W, [2026-08-11T09:41:13.857195 #2111] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1142gitlab # [ 117.575387] sidekiq-cluster[2141]: 2026-08-11T09:41:16.526Z pid=2141 tid=tzp INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2141, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>426921984}1143gitlab # [ 117.767408] sidekiq-cluster[2141]: W, [2026-08-11T09:41:16.718770 #2141] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1144gitlab # [ 117.809414] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:16.760Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1145gitlab # [ 119.619513] gitlab-workhorse[1283]: time="2026-08-11T09:41:18Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1146gitlab # [ 120.077974] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.028Z","message":"GitLab reliable fetch activated!"}1147gitlab # [ 120.084688] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.028Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1148gitlab # [ 120.109763] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.061Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1149gitlab # [ 120.119169] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.066Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1150gitlab # [ 120.121727] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.070Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1151gitlab # [ 120.144317] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.095Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1152gitlab # [ 120.156621] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.108Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1153gitlab # [ 120.164482] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.112Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1154gitlab # [ 120.168112] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.118Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1155gitlab # [ 120.172815] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.123Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1156gitlab # [ 120.177342] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.127Z","message":"Cron Jobs - added job with name expire_build_artifacts_worker in the namespace default"}1157gitlab # [ 120.180827] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.132Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1158gitlab # [ 120.185543] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.137Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1159gitlab # [ 120.191526] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.143Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1160gitlab # [ 120.197220] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.148Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1161gitlab # [ 120.202620] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.154Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1162gitlab # [ 120.206644] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.157Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1163gitlab # [ 120.211419] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.162Z","message":"Cron Jobs - added job with name environments_auto_delete_cron_worker in the namespace default"}1164gitlab # [ 120.215987] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.167Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1165gitlab # [ 120.224353] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.175Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1166gitlab # [ 120.232956] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.184Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1167gitlab # [ 120.241309] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.192Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1168gitlab # [ 120.249708] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.201Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1169gitlab # [ 120.258212] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.209Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1170gitlab # [ 120.266364] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.217Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1171gitlab # [ 120.274337] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.225Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1172gitlab # [ 120.282089] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.233Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1173gitlab # [ 120.292377] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.243Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1174gitlab # [ 120.301980] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.253Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1175gitlab # [ 120.311604] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.263Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1176gitlab # [ 120.321355] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.272Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1177gitlab # [ 120.331657] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.282Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1178gitlab # [ 120.343306] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.294Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1179gitlab # [ 120.353573] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.304Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1180gitlab # [ 120.365244] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.316Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1181gitlab # [ 120.376096] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.327Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1182gitlab # [ 120.384550] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.335Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1183gitlab # [ 120.392775] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.344Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1184gitlab # [ 120.401237] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.352Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1185gitlab # [ 120.410440] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.361Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1186gitlab # [ 120.418549] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.370Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1187gitlab # [ 120.423589] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.374Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1188gitlab # [ 120.427669] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.379Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1189gitlab # [ 120.433775] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.385Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1190gitlab # [ 120.439601] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.391Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1191gitlab # [ 120.445499] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.397Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1192gitlab # [ 120.451575] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.403Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1193gitlab # [ 120.457912] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.409Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1194gitlab # [ 120.464335] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.415Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1195gitlab # [ 120.470543] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.422Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1196gitlab # [ 120.476700] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.428Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1197gitlab # [ 120.482953] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.434Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1198gitlab # [ 120.490426] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.441Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1199gitlab # [ 120.494888] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.446Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1200gitlab # [ 120.502674] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.454Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1201gitlab # [ 120.517985] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.469Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1202gitlab # [ 120.526220] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.477Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1203gitlab # [ 120.537545] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.488Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1204gitlab # [ 120.544395] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.495Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1205gitlab # [ 120.549836] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.501Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1206gitlab # [ 120.555879] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.507Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1207gitlab # [ 120.560784] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.512Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1208gitlab # [ 120.566409] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.517Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1209gitlab # [ 120.571862] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.523Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1210gitlab # [ 120.575405] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.526Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1211gitlab # [ 120.579786] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.531Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1212gitlab # [ 120.583772] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.535Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1213gitlab # [ 120.590684] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.542Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1214gitlab # [ 120.595043] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.546Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1215gitlab # [ 120.598642] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.550Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1216gitlab # [ 120.629604] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.581Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1217gitlab # [ 120.634519] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.586Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1218gitlab # [ 120.638985] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.590Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1219gitlab # [ 120.644786] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.596Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1220gitlab # [ 120.654392] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.605Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1221gitlab # [ 120.661266] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.612Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1222gitlab # [ 120.668773] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.620Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1223gitlab # [ 120.677728] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.629Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1224gitlab # [ 120.685388] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.636Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1225gitlab # [ 120.693883] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.645Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1226gitlab # [ 120.701633] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.653Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1227gitlab # [ 120.709867] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.661Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1228gitlab # [ 120.717391] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.668Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1229gitlab # [ 120.726196] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.677Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1230gitlab # [ 120.734124] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.685Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1231gitlab # [ 120.744121] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.695Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1232gitlab # [ 120.755582] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.706Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1233gitlab # [ 120.763716] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.715Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1234gitlab # [ 120.770479] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.721Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1235gitlab # [ 120.779208] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.730Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1236gitlab # [ 120.785585] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.737Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1237gitlab # [ 120.792909] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.744Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1238gitlab # [ 120.801787] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.753Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1239gitlab # [ 120.811484] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.761Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1240gitlab # [ 120.820601] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.772Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1241gitlab # [ 120.828857] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.780Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1242gitlab # [ 120.841701] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.792Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1243gitlab # [ 120.849658] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.801Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1244gitlab # [ 120.860976] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.812Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1245gitlab # [ 120.871501] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.822Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1246gitlab # [ 120.879159] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.830Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1247gitlab # [ 120.899291] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.850Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1248gitlab # [ 120.904559] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.856Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1249gitlab # [ 120.910243] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.861Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1250gitlab # [ 120.917224] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.868Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1251gitlab # [ 120.923166] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.874Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1252gitlab # [ 120.928935] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.880Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1253gitlab # [ 120.933920] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.885Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1254gitlab # [ 120.938705] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.890Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1255gitlab # [ 120.943245] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.894Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1256gitlab # [ 120.947800] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.899Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1257gitlab # [ 120.955574] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:19.906Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1258gitlab # [ 129.620981] gitlab-workhorse[1283]: time="2026-08-11T09:41:28Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1259gitlab # [ 139.624902] gitlab-workhorse[1283]: time="2026-08-11T09:41:38Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1260gitlab # [ 143.220287] sidekiq-cluster[2141]: InitializerConnections Query: SET client_min_messages TO 'warning'1261gitlab # [ 143.222704] sidekiq-cluster[2141]: InitializerConnections Backtrace: lib/feature.rb:341:in `block in current_feature_value'1262gitlab # [ 143.224526] sidekiq-cluster[2141]: InitializerConnections Backtrace: lib/feature.rb:356:in `with_feature'1263gitlab # [ 143.226157] sidekiq-cluster[2141]: InitializerConnections Backtrace: lib/feature.rb:337:in `current_feature_value'1264gitlab # [ 143.227583] sidekiq-cluster[2141]: InitializerConnections Backtrace: lib/feature.rb:130:in `enabled?'1265gitlab # [ 143.229366] sidekiq-cluster[2141]: InitializerConnections Backtrace: lib/feature.rb:145:in `disabled?'1266gitlab # [ 143.231103] sidekiq-cluster[2141]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'1267gitlab # [ 143.232642] sidekiq-cluster[2141]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1268gitlab # [ 143.269662] sidekiq-cluster[2141]: InitializerConnections Query: SET standard_conforming_strings = on1269gitlab # [ 143.271926] sidekiq-cluster[2141]: InitializerConnections Backtrace: lib/feature.rb:341:in `block in current_feature_value'1270gitlab # [ 143.274118] sidekiq-cluster[2141]: InitializerConnections Backtrace: lib/feature.rb:356:in `with_feature'1271gitlab # [ 143.278542] sidekiq-cluster[2141]: InitializerConnections Backtrace: lib/feature.rb:337:in `current_feature_value'1272gitlab # [ 143.280163] sidekiq-cluster[2141]: InitializerConnections Backtrace: lib/feature.rb:130:in `enabled?'1273gitlab # [ 143.281558] sidekiq-cluster[2141]: InitializerConnections Backtrace: lib/feature.rb:145:in `disabled?'1274gitlab # [ 143.283127] sidekiq-cluster[2141]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'1275gitlab # [ 143.284548] sidekiq-cluster[2141]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1276gitlab # [ 143.286203] sidekiq-cluster[2141]: InitializerConnections Query: SET intervalstyle = iso_86011277gitlab # [ 143.287598] sidekiq-cluster[2141]: InitializerConnections Backtrace: lib/feature.rb:341:in `block in current_feature_value'1278gitlab # [ 143.289297] sidekiq-cluster[2141]: InitializerConnections Backtrace: lib/feature.rb:356:in `with_feature'1279gitlab # [ 143.290510] sidekiq-cluster[2141]: InitializerConnections Backtrace: lib/feature.rb:337:in `current_feature_value'1280gitlab # [ 143.291897] sidekiq-cluster[2141]: InitializerConnections Backtrace: lib/feature.rb:130:in `enabled?'1281gitlab # [ 143.293175] sidekiq-cluster[2141]: InitializerConnections Backtrace: lib/feature.rb:145:in `disabled?'1282gitlab # [ 143.294383] sidekiq-cluster[2141]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'1283gitlab # [ 143.295535] sidekiq-cluster[2141]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1284gitlab # [ 143.375477] sidekiq-cluster[2141]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT t.oid, t.typname1285gitlab # [ 143.383571] sidekiq-cluster[2141]: FROM pg_type as t1286gitlab # [ 143.386506] sidekiq-cluster[2141]: WHERE t.typname IN ('int2', 'int4', 'int8', 'oid', 'float4', 'float8', 'numeric', 'bool', 'timestamp', 'timestamptz')1287gitlab # [ 143.388930] sidekiq-cluster[2141]: InitializerConnections Backtrace: lib/feature.rb:341:in `block in current_feature_value'1288gitlab # [ 143.391665] sidekiq-cluster[2141]: InitializerConnections Backtrace: lib/feature.rb:356:in `with_feature'1289gitlab # [ 143.397743] sidekiq-cluster[2141]: InitializerConnections Backtrace: lib/feature.rb:337:in `current_feature_value'1290gitlab # [ 143.402838] sidekiq-cluster[2141]: InitializerConnections Backtrace: lib/feature.rb:130:in `enabled?'1291gitlab # [ 143.404756] sidekiq-cluster[2141]: InitializerConnections Backtrace: lib/feature.rb:145:in `disabled?'1292gitlab # [ 143.407608] sidekiq-cluster[2141]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'1293gitlab # [ 143.409750] sidekiq-cluster[2141]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1294gitlab # [ 143.412602] sidekiq-cluster[2141]: InitializerConnections Query: SET SESSION timezone TO 'UTC'1295gitlab # [ 143.414144] sidekiq-cluster[2141]: InitializerConnections Backtrace: lib/feature.rb:341:in `block in current_feature_value'1296gitlab # [ 143.415248] sidekiq-cluster[2141]: InitializerConnections Backtrace: lib/feature.rb:356:in `with_feature'1297gitlab # [ 143.416452] sidekiq-cluster[2141]: InitializerConnections Backtrace: lib/feature.rb:337:in `current_feature_value'1298gitlab # [ 143.417827] sidekiq-cluster[2141]: InitializerConnections Backtrace: lib/feature.rb:130:in `enabled?'1299gitlab # [ 143.419446] sidekiq-cluster[2141]: InitializerConnections Backtrace: lib/feature.rb:145:in `disabled?'1300gitlab # [ 143.420912] sidekiq-cluster[2141]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'1301gitlab # [ 143.425091] sidekiq-cluster[2141]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1302gitlab # [ 143.425952] sidekiq-cluster[2141]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT "feature_gates"."key", "feature_gates"."value" FROM "feature_gates" WHERE "feature_gates"."feature_key" = 'sidekiq_throttling_middleware'1303gitlab # [ 143.427373] sidekiq-cluster[2141]: InitializerConnections Backtrace: lib/feature.rb:341:in `block in current_feature_value'1304gitlab # [ 143.428261] sidekiq-cluster[2141]: InitializerConnections Backtrace: lib/feature.rb:356:in `with_feature'1305gitlab # [ 143.429080] sidekiq-cluster[2141]: InitializerConnections Backtrace: lib/feature.rb:337:in `current_feature_value'1306gitlab # [ 143.430864] sidekiq-cluster[2141]: InitializerConnections Backtrace: lib/feature.rb:130:in `enabled?'1307gitlab # [ 143.431847] sidekiq-cluster[2141]: InitializerConnections Backtrace: lib/feature.rb:145:in `disabled?'1308gitlab # [ 143.432956] sidekiq-cluster[2141]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'1309gitlab # [ 143.434107] sidekiq-cluster[2141]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1310gitlab # [ 144.509881] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:43.460Z","message":"Booted Rails 7.2.3 application in production environment"}1311gitlab # [ 144.517548] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:43.461Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1312gitlab # [ 144.520263] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:43.461Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1313gitlab # [ 144.522710] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:43.461Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1314gitlab # [ 144.526125] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:43.463Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1315gitlab # [ 144.829223] bundle[2111]: {"timestamp":"2026-08-11T09:41:43.779Z","pid":2111,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1316gitlab # [ 144.831840] bundle[2111]: {"timestamp":"2026-08-11T09:41:43.779Z","pid":2111,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1317gitlab # [ 144.835182] bundle[2111]: {"timestamp":"2026-08-11T09:41:43.779Z","pid":2111,"message":"! #\u003cThread:0x00007395bd3c8798 /nix/store/g5qraa51hgg5fl7n3da89ygf00qfv95x-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/g5qraa51hgg5fl7n3da89ygf00qfv95x-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1318gitlab # [ 144.837938] bundle[2111]: {"timestamp":"2026-08-11T09:41:43.779Z","pid":2111,"message":"! #\u003cThread:0x00007395bd649c60 /nix/store/wg5r0zmy3rh1kga7z4z7mbs298p0wxli-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/wg5r0zmy3rh1kga7z4z7mbs298p0wxli-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1319gitlab # [ 144.841430] bundle[2111]: {"timestamp":"2026-08-11T09:41:43.779Z","pid":2111,"message":"Use Ctrl-C to stop"}1320gitlab # [ 144.843932] bundle[2111]: {"timestamp":"2026-08-11T09:41:43.780Z","pid":2111,"message":"Sending status to systemd every 1.0 sec"}1321gitlab # [ 145.328408] bundle[2111]: {"timestamp":"2026-08-11T09:41:44.279Z","pid":2111,"message":"- Worker 0 (PID: 2683) booted in 0.39s, phase: 0"}1322gitlab # [ 145.344755] bundle[2111]: {"timestamp":"2026-08-11T09:41:44.296Z","pid":2111,"message":"- Worker 1 (PID: 2688) booted in 0.38s, phase: 0"}1323gitlab # [ 145.355457] systemd[1]: Started gitlab.service.1324gitlab # [ 145.359922] systemd[1]: Reached target Common target for all GitLab services..1325gitlab # [ 145.365779] systemd[1]: Starting setup-gitlab.service...1326gitlab # [ 145.379529] setup-gitlab-start[2717]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1327gitlab # [ 146.015170] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:44.965Z","message":"Cleaning working queues"}1328gitlab # [ 146.019495] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:44.969Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"35161348f6775d4383019c41","created_at":"2026-08-11T09:40:43.274Z","trace_propagation_headers":{"sentry-trace":"ba0673825236497f84ed109b8ba241b8-f560ed4c92c54761","baggage":"sentry-trace_id=ba0673825236497f84ed109b8ba241b8,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"e8f78208825f83c6f0223594fe02902b","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-11T09:40:43.290Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-35161348f6775d4383019c41: start","job_status":"start","queue_duration_s":61.679057,"scheduling_latency_s":61.679131}1329gitlab # [ 146.244865] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:41:45.195Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"35161348f6775d4383019c41","created_at":"2026-08-11T09:40:43.274Z","trace_propagation_headers":{"sentry-trace":"ba0673825236497f84ed109b8ba241b8-f560ed4c92c54761","baggage":"sentry-trace_id=ba0673825236497f84ed109b8ba241b8,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"e8f78208825f83c6f0223594fe02902b","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-11T09:40:43.290Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-35161348f6775d4383019c41: done: 0.226634 sec","job_status":"done","queue_duration_s":61.679057,"scheduling_latency_s":61.679131,"redis_calls":24,"redis_duration_s":0.010237,"redis_read_bytes":912,"redis_write_bytes":2622,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.004856,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003475,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001906,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":9,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.069428,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.116988332,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.226634,"completed_at":"2026-08-11T09:41:45.195Z","load_balancing_strategy":"primary","db_duration_s":0.096006,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1330gitlab # [ 147.773883] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:41:46 +0000] "GET /users/sign_in HTTP/1.1" 200 10624 "" "curl/8.20.0" 23611331gitlab # [ 147.783218] setup-gitlab-start[2743]: ++ curl -fs -X POST -H 'Content-Type: application/json' -d '{"grant_type":"password","username":"root","password":"notproduction"}' http://gitlab/oauth/token1332gitlab # [ 147.785423] setup-gitlab-start[2744]: ++ jq -r .access_token1333gitlab # [ 148.585994] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:41:47 +0000] "POST /oauth/token HTTP/1.1" 200 244 "" "curl/8.20.0" 7811334gitlab # [ 148.597525] setup-gitlab-start[2717]: + BEARER=61162ccb81f6bf55d09da26ecc6a2666d9c9b04cf41193931719f9d57d7a218c1335gitlab # [ 148.600103] setup-gitlab-start[2717]: + AUTH='Authorization: Bearer 61162ccb81f6bf55d09da26ecc6a2666d9c9b04cf41193931719f9d57d7a218c'1336gitlab # [ 148.601953] setup-gitlab-start[2717]: + curl -fs -X PUT -H 'Authorization: Bearer 61162ccb81f6bf55d09da26ecc6a2666d9c9b04cf41193931719f9d57d7a218c' 'http://gitlab/api/v4/application/settings?allow_local_requests_from_web_hooks_and_services=true'1337gitlab # [ 150.117991] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:41:49 +0000] "PUT /api/v4/application/settings?allow_local_requests_from_web_hooks_and_services=true HTTP/1.1" 200 17133 "" "curl/8.20.0" 14781338gitlab # [ 150.130706] setup-gitlab-start[2717]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner Rails.cache.clear1339gitlab # [ 150.152355] runuser[2768]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1340gitlab # [ 150.527455] setup-gitlab-start[2769]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1341gitlab # [ 150.530184] setup-gitlab-start[2769]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1342gitlab # [ 150.532994] setup-gitlab-start[2769]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1343gitlab # [ 151.125994] setup-gitlab-start[2769]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1344gitlab # [ 151.128946] setup-gitlab-start[2769]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1345gitlab # [ 151.132254] setup-gitlab-start[2769]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1346gitlab # [ 163.127794] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:02.078Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"2f3113f05eeb8c832d97a245","created_at":"2026-08-11T09:42:02.043Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"16f01f0b9784362cb3b74b8a695c2aa4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-11T09:42:02.075Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-2f3113f05eeb8c832d97a245: start","job_status":"start","queue_duration_s":0.002337,"scheduling_latency_s":0.00245}1347gitlab # [ 163.227136] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:02.178Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1348gitlab # [ 163.278256] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:02.229Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"2f3113f05eeb8c832d97a245","created_at":"2026-08-11T09:42:02.043Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"16f01f0b9784362cb3b74b8a695c2aa4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-11T09:42:02.075Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-2f3113f05eeb8c832d97a245: done: 0.151021 sec","job_status":"done","queue_duration_s":0.002337,"scheduling_latency_s":0.00245,"redis_calls":10,"redis_duration_s":0.040545,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003548,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.033793,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003204,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029836,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001383695,"duration_s":0.151021,"completed_at":"2026-08-11T09:42:02.229Z","load_balancing_strategy":"primary","db_duration_s":0.003595,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1349gitlab # [ 163.379492] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:02.330Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"d03f287806fb153e4d8f228c","created_at":"2026-08-11T09:42:02.159Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e5eb86921c73a94ff27766a2dd097712","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.202Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-d03f287806fb153e4d8f228c: start","job_status":"start","queue_duration_s":0.127982,"scheduling_latency_s":0.128061}1350gitlab # [ 163.504115] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:02.455Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1351gitlab # [ 163.537795] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:02.488Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"d03f287806fb153e4d8f228c","created_at":"2026-08-11T09:42:02.159Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e5eb86921c73a94ff27766a2dd097712","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.202Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-d03f287806fb153e4d8f228c: done: 0.159062 sec","job_status":"done","queue_duration_s":0.127982,"scheduling_latency_s":0.128061,"redis_calls":10,"redis_duration_s":0.015057000000000001,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002817,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007978,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004262,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02516,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000727467,"duration_s":0.159062,"completed_at":"2026-08-11T09:42:02.488Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.028899,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 163.635430] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:02.586Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"cdc91465e30aceb378762651","created_at":"2026-08-11T09:42:02.230Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.336Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-cdc91465e30aceb378762651: start","job_status":"start","queue_duration_s":0.249941,"scheduling_latency_s":0.250015}1353gitlab # [ 163.967448] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:02.918Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"cdc91465e30aceb378762651","created_at":"2026-08-11T09:42:02.230Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.336Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-cdc91465e30aceb378762651: done: 0.332846 sec","job_status":"done","queue_duration_s":0.249941,"scheduling_latency_s":0.250015,"redis_calls":71,"redis_duration_s":0.11909,"redis_read_bytes":120,"redis_write_bytes":42524,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.039188,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001225,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37335,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.075445,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.003232,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.147067,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.008543823,"duration_s":0.332846,"completed_at":"2026-08-11T09:42:02.918Z","load_balancing_strategy":"primary","db_duration_s":0.013581,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1354gitlab # [ 164.059849] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:03.010Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"81e5da164b2bd21c6acb615c","created_at":"2026-08-11T09:42:02.368Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b15bb63bed2c3876676d6350cc588924","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.389Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-81e5da164b2bd21c6acb615c: start","job_status":"start","queue_duration_s":0.620382,"scheduling_latency_s":0.620459}1355gitlab # [ 164.158896] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:03.108Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"81e5da164b2bd21c6acb615c","created_at":"2026-08-11T09:42:02.368Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b15bb63bed2c3876676d6350cc588924","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.389Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-81e5da164b2bd21c6acb615c: done: 0.09873 sec","job_status":"done","queue_duration_s":0.620382,"scheduling_latency_s":0.620459,"redis_calls":12,"redis_duration_s":0.016106,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00873,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004988,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002388,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032643,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000717689,"duration_s":0.09873,"completed_at":"2026-08-11T09:42:03.108Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009341,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356gitlab # [ 164.177418] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:03.128Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"6d6532888e2ad13cc9a749dd","created_at":"2026-08-11T09:42:02.417Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a0f15d7ef75df8d6a9b1cff668a0bca2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.431Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-6d6532888e2ad13cc9a749dd: start","job_status":"start","queue_duration_s":0.697091,"scheduling_latency_s":0.697165}1357gitlab # [ 164.594111] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:03.544Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"6d6532888e2ad13cc9a749dd","created_at":"2026-08-11T09:42:02.417Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a0f15d7ef75df8d6a9b1cff668a0bca2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.431Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-6d6532888e2ad13cc9a749dd: done: 0.41684 sec","job_status":"done","queue_duration_s":0.697091,"scheduling_latency_s":0.697165,"redis_calls":12,"redis_duration_s":0.015244,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.006615,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005394,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003235,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.036,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.036,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.216704,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001920077,"exclusive_lock_hold_duration_s":0.284731998,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.41684,"completed_at":"2026-08-11T09:42:03.544Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.062016,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358gitlab # [ 164.599278] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:03.546Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"d4c439ef67c9b4d9944abaf2","created_at":"2026-08-11T09:42:02.444Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7c5a1c034d56c9a1d6ee97569f2836fb","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.451Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-d4c439ef67c9b4d9944abaf2: start","job_status":"start","queue_duration_s":1.094853,"scheduling_latency_s":1.094877}1359gitlab # [ 164.714664] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:03.572Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"d4c439ef67c9b4d9944abaf2","created_at":"2026-08-11T09:42:02.444Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7c5a1c034d56c9a1d6ee97569f2836fb","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.451Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-d4c439ef67c9b4d9944abaf2: done: 0.025779 sec","job_status":"done","queue_duration_s":1.094853,"scheduling_latency_s":1.094877,"redis_calls":12,"redis_duration_s":0.00299,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000481,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001492,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001017,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011898,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000506489,"exclusive_lock_hold_duration_s":0.006432661,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.025779,"completed_at":"2026-08-11T09:42:03.572Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006246,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360gitlab # [ 164.723655] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:03.574Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"f2344bba1b35854b3ed7e633","created_at":"2026-08-11T09:42:02.477Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4162fc5d7ad405071ab601323bc360ab","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.581Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-f2344bba1b35854b3ed7e633: start","job_status":"start","queue_duration_s":0.992271,"scheduling_latency_s":0.992292}1361gitlab # [ 164.747329] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:03.585Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1362gitlab # [ 164.752459] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:03.592Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"f2344bba1b35854b3ed7e633","created_at":"2026-08-11T09:42:02.477Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4162fc5d7ad405071ab601323bc360ab","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.581Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-f2344bba1b35854b3ed7e633: done: 0.018488 sec","job_status":"done","queue_duration_s":0.992271,"scheduling_latency_s":0.992292,"redis_calls":10,"redis_duration_s":0.003458,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000786,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001949,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000723,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010085,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000494477,"duration_s":0.018488,"completed_at":"2026-08-11T09:42:03.592Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000609,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1363gitlab # [ 164.846672] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:03.594Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"055882cf726978a270759f4f","created_at":"2026-08-11T09:42:02.617Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"604ca3b64e28362c95d92f286e008a7e","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.641Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-055882cf726978a270759f4f: start","job_status":"start","queue_duration_s":0.952721,"scheduling_latency_s":0.952742}1364gitlab # [ 164.848612] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:03.618Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"055882cf726978a270759f4f","created_at":"2026-08-11T09:42:02.617Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"604ca3b64e28362c95d92f286e008a7e","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.641Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-055882cf726978a270759f4f: done: 0.024477 sec","job_status":"done","queue_duration_s":0.952721,"scheduling_latency_s":0.952742,"redis_calls":10,"redis_duration_s":0.004311,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00095,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002444,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000917,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011904,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000503416,"duration_s":0.024477,"completed_at":"2026-08-11T09:42:03.618Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003812,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1365gitlab # [ 164.908301] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:03.620Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"44820bf7fb39ff57e8e33a25","created_at":"2026-08-11T09:42:02.657Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1409b8a73a358d244158e1e358f30c03","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.675Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-44820bf7fb39ff57e8e33a25: start","job_status":"start","queue_duration_s":0.944864,"scheduling_latency_s":0.944886}1366gitlab # [ 164.931178] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:03.647Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"44820bf7fb39ff57e8e33a25","created_at":"2026-08-11T09:42:02.657Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1409b8a73a358d244158e1e358f30c03","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.675Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-44820bf7fb39ff57e8e33a25: done: 0.026763 sec","job_status":"done","queue_duration_s":0.944864,"scheduling_latency_s":0.944886,"redis_calls":10,"redis_duration_s":0.004385,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000818,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002632,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000935,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013012,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000593092,"duration_s":0.026763,"completed_at":"2026-08-11T09:42:03.647Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004879,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1367gitlab # [ 164.998515] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:03.649Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"ee8a8ed3292fffa7572b4a05","created_at":"2026-08-11T09:42:02.721Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"14f646d6aaf89a3d305baf80f6760d5d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-11T09:42:02.742Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-ee8a8ed3292fffa7572b4a05: start","job_status":"start","queue_duration_s":0.90714,"scheduling_latency_s":0.907162}1368gitlab # [ 165.019990] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:03.662Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1369gitlab # [ 165.025941] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:03.669Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"ee8a8ed3292fffa7572b4a05","created_at":"2026-08-11T09:42:02.721Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"14f646d6aaf89a3d305baf80f6760d5d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-11T09:42:02.742Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-ee8a8ed3292fffa7572b4a05: done: 0.019829 sec","job_status":"done","queue_duration_s":0.90714,"scheduling_latency_s":0.907162,"redis_calls":10,"redis_duration_s":0.004069,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000948,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002264,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000857,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010194,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000391949,"duration_s":0.019829,"completed_at":"2026-08-11T09:42:03.669Z","load_balancing_strategy":"primary","db_duration_s":0.000744,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1370gitlab # [ 165.133455] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:03.670Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"f4a5f282aab1522d0b59d221","created_at":"2026-08-11T09:42:02.756Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0fb33d2259ba9bb44e484abaea79ab77","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-11T09:42:02.769Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-f4a5f282aab1522d0b59d221: start","job_status":"start","queue_duration_s":0.901599,"scheduling_latency_s":0.90162}1371gitlab # [ 165.135335] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:03.700Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"f4a5f282aab1522d0b59d221","created_at":"2026-08-11T09:42:02.756Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0fb33d2259ba9bb44e484abaea79ab77","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-11T09:42:02.769Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-f4a5f282aab1522d0b59d221: done: 0.029606 sec","job_status":"done","queue_duration_s":0.901599,"scheduling_latency_s":0.90162,"redis_calls":10,"redis_duration_s":0.002367,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000485,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001431,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000451,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016245,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000364013,"duration_s":0.029606,"completed_at":"2026-08-11T09:42:03.700Z","load_balancing_strategy":"primary","db_duration_s":0.006325,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1372gitlab # [ 165.176633] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:03.701Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"d6292ec12392e5f8b36a1d48","created_at":"2026-08-11T09:42:02.780Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"440d6e6f4da29c55794032ca0f769833","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.793Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-d6292ec12392e5f8b36a1d48: start","job_status":"start","queue_duration_s":0.908297,"scheduling_latency_s":0.90832}1373gitlab # [ 165.198414] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:03.734Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"d6292ec12392e5f8b36a1d48","created_at":"2026-08-11T09:42:02.780Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"440d6e6f4da29c55794032ca0f769833","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.793Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-d6292ec12392e5f8b36a1d48: done: 0.032399 sec","job_status":"done","queue_duration_s":0.908297,"scheduling_latency_s":0.90832,"redis_calls":16,"redis_duration_s":0.004223,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001926,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001763,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000534,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016312,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000367085,"duration_s":0.032399,"completed_at":"2026-08-11T09:42:03.734Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008347,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1374gitlab # [ 165.276881] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:03.735Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"8a1517c11035bd45b4765993","created_at":"2026-08-11T09:42:02.805Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"07df0d4a5174bf190690abcd273467a3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.816Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-8a1517c11035bd45b4765993: start","job_status":"start","queue_duration_s":0.919811,"scheduling_latency_s":0.919831}1375gitlab # [ 165.286101] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:03.746Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1376gitlab # [ 165.292103] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:03.752Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"8a1517c11035bd45b4765993","created_at":"2026-08-11T09:42:02.805Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"07df0d4a5174bf190690abcd273467a3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.816Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-8a1517c11035bd45b4765993: done: 0.017059 sec","job_status":"done","queue_duration_s":0.919811,"scheduling_latency_s":0.919831,"redis_calls":10,"redis_duration_s":0.002435,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000465,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001467,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000503,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009626,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000364293,"duration_s":0.017059,"completed_at":"2026-08-11T09:42:03.752Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000409,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1377gitlab # [ 165.418623] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:03.754Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"66fe6f172b3bea814facb2a6","created_at":"2026-08-11T09:42:02.829Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"237385aed425c08d07fa83f53432205f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.839Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-66fe6f172b3bea814facb2a6: start","job_status":"start","queue_duration_s":0.915026,"scheduling_latency_s":0.915047}1378gitlab # [ 165.420194] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:03.786Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"66fe6f172b3bea814facb2a6","created_at":"2026-08-11T09:42:02.829Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"237385aed425c08d07fa83f53432205f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.839Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-66fe6f172b3bea814facb2a6: done: 0.031917 sec","job_status":"done","queue_duration_s":0.915026,"scheduling_latency_s":0.915047,"redis_calls":19,"redis_duration_s":0.00637,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001495,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.00045,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003446,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000979,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019399,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000470451,"duration_s":0.031917,"completed_at":"2026-08-11T09:42:03.786Z","load_balancing_strategy":"primary","db_duration_s":0.00265,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379gitlab # [ 165.445875] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:03.788Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"3a4f69d8635c3a5b3232e59e","created_at":"2026-08-11T09:42:02.849Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"56cda6a48c9dc2d0265fcf4d2030d33e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.859Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-3a4f69d8635c3a5b3232e59e: start","job_status":"start","queue_duration_s":0.928246,"scheduling_latency_s":0.928269}1380gitlab # [ 165.796514] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 1270031430 wd_nsec: 12700309871381gitlab # [ 165.659916] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.610Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"3a4f69d8635c3a5b3232e59e","created_at":"2026-08-11T09:42:02.849Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"56cda6a48c9dc2d0265fcf4d2030d33e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.859Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-3a4f69d8635c3a5b3232e59e: done: 0.822673 sec","job_status":"done","queue_duration_s":0.928246,"scheduling_latency_s":0.928269,"redis_calls":12,"redis_duration_s":0.004969,"redis_read_bytes":11,"redis_write_bytes":1447,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000541,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":319,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002323,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002105,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":542,"db_count":101,"db_write_count":0,"db_cached_count":99,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":101,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":99,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":100,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":99,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.107823,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000455085,"exclusive_lock_hold_duration_s":0.8018907430000001,"extra.ci_update_locked_unknown_artifacts_worker.removed_count":0,"extra.ci_update_locked_unknown_artifacts_worker.locked_count":0,"duration_s":0.822673,"completed_at":"2026-08-11T09:42:04.610Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.705027,"urgency":"throttled","target_duration_s":300,"target_scheduling_latency_s":null}1382gitlab # [ 165.665216] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.612Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"3985d3e880f19a375abee282","created_at":"2026-08-11T09:42:02.876Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"020bfb70cb45459e61423fb8e183512c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.892Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-3985d3e880f19a375abee282: start","job_status":"start","queue_duration_s":1.719971,"scheduling_latency_s":1.719993}1383gitlab # [ 165.711277] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.632Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"3985d3e880f19a375abee282","created_at":"2026-08-11T09:42:02.876Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"020bfb70cb45459e61423fb8e183512c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.892Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-3985d3e880f19a375abee282: done: 0.019392 sec","job_status":"done","queue_duration_s":1.719971,"scheduling_latency_s":1.719993,"redis_calls":12,"redis_duration_s":0.002993,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000505,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001395,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001093,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010419,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000495874,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.019392,"completed_at":"2026-08-11T09:42:04.632Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00058,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1384gitlab # [ 165.785579] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.633Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d06519914fa64a1bc355bc83","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d06519914fa64a1bc355bc83: start","job_status":"start","queue_duration_s":1.736251,"scheduling_latency_s":1.736273}1385gitlab # [ 165.805384] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.654Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d06519914fa64a1bc355bc83","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d06519914fa64a1bc355bc83: done: 0.021171 sec","job_status":"done","queue_duration_s":1.736251,"scheduling_latency_s":1.736273,"redis_calls":16,"redis_duration_s":0.003814,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000417,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001214,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002183,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012719,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000389994,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021171,"completed_at":"2026-08-11T09:42:04.654Z","load_balancing_strategy":"primary","db_duration_s":0.000454,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1386gitlab # [ 165.906525] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.656Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6168814c321e9e37fca273b","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6168814c321e9e37fca273b: start","job_status":"start","queue_duration_s":1.758927,"scheduling_latency_s":1.758947}1387gitlab # [ 165.908197] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.672Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6168814c321e9e37fca273b","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6168814c321e9e37fca273b: done: 0.015859 sec","job_status":"done","queue_duration_s":1.758927,"scheduling_latency_s":1.758947,"redis_calls":13,"redis_duration_s":0.002987,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000936,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002051,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010169,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015859,"completed_at":"2026-08-11T09:42:04.672Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1388gitlab # [ 165.952265] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.673Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8ac602b6d8f06c4e028d2fe","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8ac602b6d8f06c4e028d2fe: start","job_status":"start","queue_duration_s":1.776417,"scheduling_latency_s":1.776478}1389gitlab # [ 166.025407] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.689Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8ac602b6d8f06c4e028d2fe","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8ac602b6d8f06c4e028d2fe: done: 0.015695 sec","job_status":"done","queue_duration_s":1.776417,"scheduling_latency_s":1.776478,"redis_calls":13,"redis_duration_s":0.0030110000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000889,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002122,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015695,"completed_at":"2026-08-11T09:42:04.689Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1390gitlab # [ 166.033150] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.690Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"748575bcaf71c1d2dfdc1670","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-748575bcaf71c1d2dfdc1670: start","job_status":"start","queue_duration_s":1.79361,"scheduling_latency_s":1.793632}1391gitlab # [ 166.053169] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.706Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"748575bcaf71c1d2dfdc1670","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-748575bcaf71c1d2dfdc1670: done: 0.015537 sec","job_status":"done","queue_duration_s":1.79361,"scheduling_latency_s":1.793632,"redis_calls":13,"redis_duration_s":0.003016,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000984,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002032,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010008,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015537,"completed_at":"2026-08-11T09:42:04.706Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 166.116354] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.707Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"461f7286acf748dbbfe99a5e","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-461f7286acf748dbbfe99a5e: start","job_status":"start","queue_duration_s":1.810557,"scheduling_latency_s":1.81058}1393gitlab # [ 166.194922] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.723Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"461f7286acf748dbbfe99a5e","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-461f7286acf748dbbfe99a5e: done: 0.016139 sec","job_status":"done","queue_duration_s":1.810557,"scheduling_latency_s":1.81058,"redis_calls":13,"redis_duration_s":0.002994,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000984,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00201,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010046,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016139,"completed_at":"2026-08-11T09:42:04.723Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 166.197297] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.725Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e8f5f107e919dc6ee9e12fe7","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e8f5f107e919dc6ee9e12fe7: start","job_status":"start","queue_duration_s":1.828052,"scheduling_latency_s":1.828074}1395gitlab # [ 166.217466] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.741Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e8f5f107e919dc6ee9e12fe7","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e8f5f107e919dc6ee9e12fe7: done: 0.015919 sec","job_status":"done","queue_duration_s":1.828052,"scheduling_latency_s":1.828074,"redis_calls":13,"redis_duration_s":0.002948,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00089,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002058,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015919,"completed_at":"2026-08-11T09:42:04.741Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396gitlab # [ 166.338461] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.742Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27e823c88663dc2f7d8fdefd","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27e823c88663dc2f7d8fdefd: start","job_status":"start","queue_duration_s":1.84529,"scheduling_latency_s":1.845312}1397gitlab # [ 166.340085] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.758Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27e823c88663dc2f7d8fdefd","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27e823c88663dc2f7d8fdefd: done: 0.015698 sec","job_status":"done","queue_duration_s":1.84529,"scheduling_latency_s":1.845312,"redis_calls":13,"redis_duration_s":0.003036,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000902,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002134,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009804,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015698,"completed_at":"2026-08-11T09:42:04.758Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398gitlab # [ 166.360089] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.759Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51780dbfdedf99e034f8eb53","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51780dbfdedf99e034f8eb53: start","job_status":"start","queue_duration_s":1.862269,"scheduling_latency_s":1.862291}1399gitlab # [ 166.379809] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.775Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51780dbfdedf99e034f8eb53","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51780dbfdedf99e034f8eb53: done: 0.015836 sec","job_status":"done","queue_duration_s":1.862269,"scheduling_latency_s":1.862291,"redis_calls":13,"redis_duration_s":0.003188,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000947,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002241,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009905,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015836,"completed_at":"2026-08-11T09:42:04.775Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400gitlab # [ 166.481242] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.776Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb24887b96583a354360519b","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb24887b96583a354360519b: start","job_status":"start","queue_duration_s":1.879413,"scheduling_latency_s":1.879478}1401gitlab # [ 166.482542] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.792Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb24887b96583a354360519b","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb24887b96583a354360519b: done: 0.015991 sec","job_status":"done","queue_duration_s":1.879413,"scheduling_latency_s":1.879478,"redis_calls":13,"redis_duration_s":0.0034419999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002437,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009892,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015991,"completed_at":"2026-08-11T09:42:04.792Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402gitlab # [ 166.521474] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.794Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da26ff456cbd287244d9a65a","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da26ff456cbd287244d9a65a: start","job_status":"start","queue_duration_s":1.896829,"scheduling_latency_s":1.896852}1403gitlab # [ 166.541141] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.809Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da26ff456cbd287244d9a65a","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da26ff456cbd287244d9a65a: done: 0.015606 sec","job_status":"done","queue_duration_s":1.896829,"scheduling_latency_s":1.896852,"redis_calls":13,"redis_duration_s":0.003088,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00097,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002118,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010242,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015606,"completed_at":"2026-08-11T09:42:04.809Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 166.622263] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.811Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c332e8f6bf3c3f852bbcf0d","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c332e8f6bf3c3f852bbcf0d: start","job_status":"start","queue_duration_s":1.913907,"scheduling_latency_s":1.913928}1405gitlab # [ 166.623912] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.827Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c332e8f6bf3c3f852bbcf0d","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c332e8f6bf3c3f852bbcf0d: done: 0.016188 sec","job_status":"done","queue_duration_s":1.913907,"scheduling_latency_s":1.913928,"redis_calls":13,"redis_duration_s":0.00328,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001222,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002058,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010592,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016188,"completed_at":"2026-08-11T09:42:04.827Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 166.682392] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.828Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c570cdc8d772da68c8f66fc","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c570cdc8d772da68c8f66fc: start","job_status":"start","queue_duration_s":1.931589,"scheduling_latency_s":1.93161}1407gitlab # [ 166.763480] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.844Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c570cdc8d772da68c8f66fc","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c570cdc8d772da68c8f66fc: done: 0.015808 sec","job_status":"done","queue_duration_s":1.931589,"scheduling_latency_s":1.93161,"redis_calls":13,"redis_duration_s":0.003125,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000998,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002127,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010515,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015808,"completed_at":"2026-08-11T09:42:04.844Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408gitlab # [ 166.765155] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.846Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e5ef761c32f34369562206ec","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e5ef761c32f34369562206ec: start","job_status":"start","queue_duration_s":1.948928,"scheduling_latency_s":1.94895}1409gitlab # [ 166.781241] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.863Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e5ef761c32f34369562206ec","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e5ef761c32f34369562206ec: done: 0.017274 sec","job_status":"done","queue_duration_s":1.948928,"scheduling_latency_s":1.94895,"redis_calls":13,"redis_duration_s":0.003901,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001114,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002787,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010667,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017274,"completed_at":"2026-08-11T09:42:04.863Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410gitlab # [ 166.909553] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.865Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d2c45644eb72403012d4a41e","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d2c45644eb72403012d4a41e: start","job_status":"start","queue_duration_s":1.968008,"scheduling_latency_s":1.96803}1411gitlab # [ 166.910855] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.880Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d2c45644eb72403012d4a41e","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d2c45644eb72403012d4a41e: done: 0.01566 sec","job_status":"done","queue_duration_s":1.968008,"scheduling_latency_s":1.96803,"redis_calls":13,"redis_duration_s":0.003035,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001029,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002006,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010078,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01566,"completed_at":"2026-08-11T09:42:04.880Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1412gitlab # [ 166.922343] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.882Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"690178c8e26d380e12800c41","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-690178c8e26d380e12800c41: start","job_status":"start","queue_duration_s":1.98514,"scheduling_latency_s":1.985163}1413gitlab # [ 166.942134] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.897Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"690178c8e26d380e12800c41","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-690178c8e26d380e12800c41: done: 0.015499 sec","job_status":"done","queue_duration_s":1.98514,"scheduling_latency_s":1.985163,"redis_calls":13,"redis_duration_s":0.0031260000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001089,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002037,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015499,"completed_at":"2026-08-11T09:42:04.897Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1414gitlab # [ 167.004575] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.899Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b1c0db00b7173833459a6f2","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b1c0db00b7173833459a6f2: start","job_status":"start","queue_duration_s":2.002068,"scheduling_latency_s":2.00209}1415gitlab # [ 167.024187] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.915Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b1c0db00b7173833459a6f2","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b1c0db00b7173833459a6f2: done: 0.015672 sec","job_status":"done","queue_duration_s":2.002068,"scheduling_latency_s":2.00209,"redis_calls":13,"redis_duration_s":0.0030410000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00093,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002111,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010031,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015672,"completed_at":"2026-08-11T09:42:04.915Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1416gitlab # [ 167.119712] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.916Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"26073860cfaef6d8d8445529","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-26073860cfaef6d8d8445529: start","job_status":"start","queue_duration_s":2.019138,"scheduling_latency_s":2.019158}1417gitlab # [ 167.121296] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.932Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"26073860cfaef6d8d8445529","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-26073860cfaef6d8d8445529: done: 0.016172 sec","job_status":"done","queue_duration_s":2.019138,"scheduling_latency_s":2.019158,"redis_calls":13,"redis_duration_s":0.0031650000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000978,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002187,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010063,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016172,"completed_at":"2026-08-11T09:42:04.932Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1418gitlab # [ 167.165382] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.934Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63daca8038c05b9e123b9945","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63daca8038c05b9e123b9945: start","job_status":"start","queue_duration_s":2.036677,"scheduling_latency_s":2.036699}1419gitlab # [ 167.185314] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.949Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63daca8038c05b9e123b9945","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63daca8038c05b9e123b9945: done: 0.015999 sec","job_status":"done","queue_duration_s":2.036677,"scheduling_latency_s":2.036699,"redis_calls":13,"redis_duration_s":0.003419,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001095,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002324,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009945,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015999,"completed_at":"2026-08-11T09:42:04.949Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1420gitlab # [ 167.261805] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.951Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c6291f56386f9860177d40b8","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c6291f56386f9860177d40b8: start","job_status":"start","queue_duration_s":2.054365,"scheduling_latency_s":2.054386}1421gitlab # [ 167.264378] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.969Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c6291f56386f9860177d40b8","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c6291f56386f9860177d40b8: done: 0.017362 sec","job_status":"done","queue_duration_s":2.054365,"scheduling_latency_s":2.054386,"redis_calls":13,"redis_duration_s":0.004512,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001328,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003184,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010318,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017362,"completed_at":"2026-08-11T09:42:04.968Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1422gitlab # [ 167.326254] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:04.970Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae4e4d48593bb95213bfe725","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae4e4d48593bb95213bfe725: start","job_status":"start","queue_duration_s":2.073386,"scheduling_latency_s":2.073408}1423gitlab # [ 167.402294] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:05.005Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae4e4d48593bb95213bfe725","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae4e4d48593bb95213bfe725: done: 0.034379 sec","job_status":"done","queue_duration_s":2.073386,"scheduling_latency_s":2.073408,"redis_calls":13,"redis_duration_s":0.012724,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002136,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.010588,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015894,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034379,"completed_at":"2026-08-11T09:42:05.005Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1424gitlab # [ 167.405189] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:05.006Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2122b13e79367ab2aa5a8e43","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2122b13e79367ab2aa5a8e43: start","job_status":"start","queue_duration_s":2.109336,"scheduling_latency_s":2.109367}1425gitlab # [ 167.425259] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:05.023Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2122b13e79367ab2aa5a8e43","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2122b13e79367ab2aa5a8e43: done: 0.016952 sec","job_status":"done","queue_duration_s":2.109336,"scheduling_latency_s":2.109367,"redis_calls":13,"redis_duration_s":0.0033410000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000928,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002413,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010227,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016952,"completed_at":"2026-08-11T09:42:05.023Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426gitlab # [ 167.543957] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:05.025Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e29accb790dd31d83c06e4e","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e29accb790dd31d83c06e4e: start","job_status":"start","queue_duration_s":2.12773,"scheduling_latency_s":2.127752}1427gitlab # [ 167.545387] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:05.041Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e29accb790dd31d83c06e4e","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e29accb790dd31d83c06e4e: done: 0.015975 sec","job_status":"done","queue_duration_s":2.12773,"scheduling_latency_s":2.127752,"redis_calls":13,"redis_duration_s":0.003078,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00098,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00997,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015975,"completed_at":"2026-08-11T09:42:05.040Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428gitlab # [ 167.566326] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:05.042Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a64317d1fa10d2b07080bc58","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a64317d1fa10d2b07080bc58: start","job_status":"start","queue_duration_s":2.145182,"scheduling_latency_s":2.145206}1429gitlab # [ 167.586073] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:05.058Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a64317d1fa10d2b07080bc58","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a64317d1fa10d2b07080bc58: done: 0.015793 sec","job_status":"done","queue_duration_s":2.145182,"scheduling_latency_s":2.145206,"redis_calls":13,"redis_duration_s":0.003244,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000924,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00232,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009887,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015793,"completed_at":"2026-08-11T09:42:05.058Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 167.686125] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:05.059Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09a728c2ec6365439e605fd5","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09a728c2ec6365439e605fd5: start","job_status":"start","queue_duration_s":2.162304,"scheduling_latency_s":2.162325}1431gitlab # [ 167.687185] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:05.075Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09a728c2ec6365439e605fd5","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09a728c2ec6365439e605fd5: done: 0.015744 sec","job_status":"done","queue_duration_s":2.162304,"scheduling_latency_s":2.162325,"redis_calls":13,"redis_duration_s":0.003266,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000924,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002342,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009926,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015744,"completed_at":"2026-08-11T09:42:05.075Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432gitlab # [ 167.728182] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:05.076Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5a432e0cf2de441adb2e4e2","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5a432e0cf2de441adb2e4e2: start","job_status":"start","queue_duration_s":2.179483,"scheduling_latency_s":2.179505}1433gitlab # [ 167.747945] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:05.092Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5a432e0cf2de441adb2e4e2","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5a432e0cf2de441adb2e4e2: done: 0.015712 sec","job_status":"done","queue_duration_s":2.179483,"scheduling_latency_s":2.179505,"redis_calls":13,"redis_duration_s":0.003098,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000954,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002144,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015712,"completed_at":"2026-08-11T09:42:05.092Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434gitlab # [ 167.829483] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:05.094Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b2a5902683d288ac9e69dfb","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b2a5902683d288ac9e69dfb: start","job_status":"start","queue_duration_s":2.196668,"scheduling_latency_s":2.196689}1435gitlab # [ 167.831107] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:05.110Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b2a5902683d288ac9e69dfb","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b2a5902683d288ac9e69dfb: done: 0.016153 sec","job_status":"done","queue_duration_s":2.196668,"scheduling_latency_s":2.196689,"redis_calls":13,"redis_duration_s":0.003161,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000968,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002193,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01038,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016153,"completed_at":"2026-08-11T09:42:05.110Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436gitlab # [ 167.889376] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:05.111Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c4cbc07f0d6c4574df3658ec","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c4cbc07f0d6c4574df3658ec: start","job_status":"start","queue_duration_s":2.214339,"scheduling_latency_s":2.214361}1437gitlab # [ 167.970378] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:05.128Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c4cbc07f0d6c4574df3658ec","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c4cbc07f0d6c4574df3658ec: done: 0.016533 sec","job_status":"done","queue_duration_s":2.214339,"scheduling_latency_s":2.214361,"redis_calls":13,"redis_duration_s":0.003138,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001006,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002132,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010405,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016533,"completed_at":"2026-08-11T09:42:05.128Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438gitlab # [ 167.972181] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:05.129Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4b7189b3fcf52f6164f86b3","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4b7189b3fcf52f6164f86b3: start","job_status":"start","queue_duration_s":2.232569,"scheduling_latency_s":2.232593}1439gitlab # [ 167.988270] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:05.146Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4b7189b3fcf52f6164f86b3","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4b7189b3fcf52f6164f86b3: done: 0.016265 sec","job_status":"done","queue_duration_s":2.232569,"scheduling_latency_s":2.232593,"redis_calls":13,"redis_duration_s":0.0029560000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000933,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002023,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01083,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016265,"completed_at":"2026-08-11T09:42:05.146Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1440gitlab # [ 168.111614] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:05.147Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0702caf2a01477b8b1a6c30","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0702caf2a01477b8b1a6c30: start","job_status":"start","queue_duration_s":2.250503,"scheduling_latency_s":2.250525}1441gitlab # [ 168.112954] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:05.163Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0702caf2a01477b8b1a6c30","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0702caf2a01477b8b1a6c30: done: 0.016194 sec","job_status":"done","queue_duration_s":2.250503,"scheduling_latency_s":2.250525,"redis_calls":13,"redis_duration_s":0.00317,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001047,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002123,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010363,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016194,"completed_at":"2026-08-11T09:42:05.163Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 168.129119] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:05.165Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80d62f075032a85f9621b1df","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80d62f075032a85f9621b1df: start","job_status":"start","queue_duration_s":2.268103,"scheduling_latency_s":2.268125}1443gitlab # [ 168.149130] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:05.181Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80d62f075032a85f9621b1df","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80d62f075032a85f9621b1df: done: 0.016484 sec","job_status":"done","queue_duration_s":2.268103,"scheduling_latency_s":2.268125,"redis_calls":13,"redis_duration_s":0.003216,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00104,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002176,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010499,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016484,"completed_at":"2026-08-11T09:42:05.181Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444gitlab # [ 168.211210] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:05.183Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1255a4985824e3ebe3ebf0a2","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1255a4985824e3ebe3ebf0a2: start","job_status":"start","queue_duration_s":2.285924,"scheduling_latency_s":2.285947}1445gitlab # [ 168.230875] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:05.199Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1255a4985824e3ebe3ebf0a2","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1255a4985824e3ebe3ebf0a2: done: 0.016505 sec","job_status":"done","queue_duration_s":2.285924,"scheduling_latency_s":2.285947,"redis_calls":13,"redis_duration_s":0.0030359999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000985,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002051,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010405,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016505,"completed_at":"2026-08-11T09:42:05.199Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446gitlab # [ 168.293718] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:05.201Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d20a7f416460bf81b18b88a","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d20a7f416460bf81b18b88a: start","job_status":"start","queue_duration_s":2.304068,"scheduling_latency_s":2.304089}1447gitlab # [ 168.312882] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:05.217Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d20a7f416460bf81b18b88a","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d20a7f416460bf81b18b88a: done: 0.016401 sec","job_status":"done","queue_duration_s":2.304068,"scheduling_latency_s":2.304089,"redis_calls":13,"redis_duration_s":0.0030499999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000923,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002127,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010215,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016401,"completed_at":"2026-08-11T09:42:05.217Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 168.398355] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:05.219Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9e935edda663fbb3da041aec","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9e935edda663fbb3da041aec: start","job_status":"start","queue_duration_s":2.321967,"scheduling_latency_s":2.321989}1449gitlab # [ 168.400080] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:05.236Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9e935edda663fbb3da041aec","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9e935edda663fbb3da041aec: done: 0.017071 sec","job_status":"done","queue_duration_s":2.321967,"scheduling_latency_s":2.321989,"redis_calls":13,"redis_duration_s":0.003229,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001038,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002191,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010462,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017071,"completed_at":"2026-08-11T09:42:05.236Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1450gitlab # [ 168.454247] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:05.237Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"855928cb7f39eb148e2caad8","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-855928cb7f39eb148e2caad8: start","job_status":"start","queue_duration_s":2.340399,"scheduling_latency_s":2.34042}1451gitlab # [ 168.552315] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:07.502Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"855928cb7f39eb148e2caad8","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-855928cb7f39eb148e2caad8: done: 2.265145 sec","job_status":"done","queue_duration_s":2.340399,"scheduling_latency_s":2.34042,"redis_calls":13,"redis_duration_s":0.0037289999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002208,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009157,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":2.265145,"completed_at":"2026-08-11T09:42:07.502Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1452gitlab # [ 168.589089] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:07.506Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8775099e6d7fd365069a6496","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8775099e6d7fd365069a6496: start","job_status":"start","queue_duration_s":4.60883,"scheduling_latency_s":4.60889}1453gitlab # [ 168.590431] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:07.526Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8775099e6d7fd365069a6496","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8775099e6d7fd365069a6496: done: 0.020494 sec","job_status":"done","queue_duration_s":4.60883,"scheduling_latency_s":4.60889,"redis_calls":13,"redis_duration_s":0.003189,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000969,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00222,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012032,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020494,"completed_at":"2026-08-11T09:42:07.526Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454gitlab # [ 168.625153] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:07.528Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"14868186bb70fae09bfd2ed5","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-14868186bb70fae09bfd2ed5: start","job_status":"start","queue_duration_s":4.630686,"scheduling_latency_s":4.630708}1455gitlab # [ 168.649111] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:07.600Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"14868186bb70fae09bfd2ed5","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-14868186bb70fae09bfd2ed5: done: 0.072421 sec","job_status":"done","queue_duration_s":4.630686,"scheduling_latency_s":4.630708,"redis_calls":13,"redis_duration_s":0.003505,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001189,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002316,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.064104,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.072421,"completed_at":"2026-08-11T09:42:07.600Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1456gitlab # [ 168.708100] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:07.602Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2c14351e5cb0432ed24a93c","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2c14351e5cb0432ed24a93c: start","job_status":"start","queue_duration_s":4.704684,"scheduling_latency_s":4.704712}1457gitlab # [ 168.727493] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:07.618Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2c14351e5cb0432ed24a93c","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2c14351e5cb0432ed24a93c: done: 0.016079 sec","job_status":"done","queue_duration_s":4.704684,"scheduling_latency_s":4.704712,"redis_calls":13,"redis_duration_s":0.003051,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000973,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002078,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00995,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016079,"completed_at":"2026-08-11T09:42:07.618Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1458gitlab # [ 168.802089] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:07.619Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f76d70964150f3404592c94","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f76d70964150f3404592c94: start","job_status":"start","queue_duration_s":4.722136,"scheduling_latency_s":4.722159}1459gitlab # [ 168.808209] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:07.635Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f76d70964150f3404592c94","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f76d70964150f3404592c94: done: 0.015741 sec","job_status":"done","queue_duration_s":4.722136,"scheduling_latency_s":4.722159,"redis_calls":13,"redis_duration_s":0.0030889999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000939,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00215,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009507,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015741,"completed_at":"2026-08-11T09:42:07.635Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460gitlab # [ 168.871380] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:07.636Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b4c3a2a945de19fc7f4dff5f","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b4c3a2a945de19fc7f4dff5f: start","job_status":"start","queue_duration_s":4.739634,"scheduling_latency_s":4.739656}1461gitlab # [ 168.945351] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:07.653Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b4c3a2a945de19fc7f4dff5f","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b4c3a2a945de19fc7f4dff5f: done: 0.016072 sec","job_status":"done","queue_duration_s":4.739634,"scheduling_latency_s":4.739656,"redis_calls":13,"redis_duration_s":0.0033569999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000885,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002472,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010168,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016072,"completed_at":"2026-08-11T09:42:07.652Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1462gitlab # [ 168.952330] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:07.654Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28d341e4805a7a1f01d14875","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28d341e4805a7a1f01d14875: start","job_status":"start","queue_duration_s":4.757182,"scheduling_latency_s":4.757205}1463gitlab # [ 168.972327] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:07.670Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28d341e4805a7a1f01d14875","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28d341e4805a7a1f01d14875: done: 0.015831 sec","job_status":"done","queue_duration_s":4.757182,"scheduling_latency_s":4.757205,"redis_calls":13,"redis_duration_s":0.003069,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000906,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002163,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010084,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015831,"completed_at":"2026-08-11T09:42:07.670Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1464gitlab # [ 169.089985] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:07.671Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90d3c6fd9e298f35ba68a7f3","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90d3c6fd9e298f35ba68a7f3: start","job_status":"start","queue_duration_s":4.774326,"scheduling_latency_s":4.774347}1465gitlab # [ 169.091281] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:07.687Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90d3c6fd9e298f35ba68a7f3","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90d3c6fd9e298f35ba68a7f3: done: 0.015774 sec","job_status":"done","queue_duration_s":4.774326,"scheduling_latency_s":4.774347,"redis_calls":13,"redis_duration_s":0.003071,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000899,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002172,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010059,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015774,"completed_at":"2026-08-11T09:42:07.687Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1466gitlab # [ 169.116401] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:07.688Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"10fef48e4cef4299228868d9","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-10fef48e4cef4299228868d9: start","job_status":"start","queue_duration_s":4.791585,"scheduling_latency_s":4.791607}1467gitlab # [ 169.136391] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:07.704Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"10fef48e4cef4299228868d9","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-10fef48e4cef4299228868d9: done: 0.015506 sec","job_status":"done","queue_duration_s":4.791585,"scheduling_latency_s":4.791607,"redis_calls":13,"redis_duration_s":0.002948,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00092,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002028,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009948,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015506,"completed_at":"2026-08-11T09:42:07.704Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1468gitlab # [ 169.235346] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:07.705Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0433d5ca1fcb414ca3a90af6","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0433d5ca1fcb414ca3a90af6: start","job_status":"start","queue_duration_s":4.808397,"scheduling_latency_s":4.808419}1469gitlab # [ 169.237049] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:07.721Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0433d5ca1fcb414ca3a90af6","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0433d5ca1fcb414ca3a90af6: done: 0.016271 sec","job_status":"done","queue_duration_s":4.808397,"scheduling_latency_s":4.808419,"redis_calls":13,"redis_duration_s":0.002895,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000913,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001982,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009985,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016271,"completed_at":"2026-08-11T09:42:07.721Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470gitlab # [ 169.280339] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:07.723Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93ef797f5ca707bfce141438","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93ef797f5ca707bfce141438: start","job_status":"start","queue_duration_s":4.826006,"scheduling_latency_s":4.826028}1471gitlab # [ 169.300694] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:07.738Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93ef797f5ca707bfce141438","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93ef797f5ca707bfce141438: done: 0.015425 sec","job_status":"done","queue_duration_s":4.826006,"scheduling_latency_s":4.826028,"redis_calls":13,"redis_duration_s":0.0028840000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000933,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001951,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010403,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015425,"completed_at":"2026-08-11T09:42:07.738Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1472gitlab # [ 169.378898] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:07.740Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1614176ddbb4e0d25d4d0c41","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1614176ddbb4e0d25d4d0c41: start","job_status":"start","queue_duration_s":4.842818,"scheduling_latency_s":4.842841}1473gitlab # [ 169.380527] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:07.755Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1614176ddbb4e0d25d4d0c41","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1614176ddbb4e0d25d4d0c41: done: 0.015639 sec","job_status":"done","queue_duration_s":4.842818,"scheduling_latency_s":4.842841,"redis_calls":13,"redis_duration_s":0.0029389999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001939,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010343,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015639,"completed_at":"2026-08-11T09:42:07.755Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1474gitlab # [ 169.504987] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:07.757Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48dfb0dcc7b807e3ed6a61a2","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48dfb0dcc7b807e3ed6a61a2: start","job_status":"start","queue_duration_s":4.85984,"scheduling_latency_s":4.859872}1475gitlab # [ 169.506429] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:07.772Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48dfb0dcc7b807e3ed6a61a2","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48dfb0dcc7b807e3ed6a61a2: done: 0.015527 sec","job_status":"done","queue_duration_s":4.85984,"scheduling_latency_s":4.859872,"redis_calls":13,"redis_duration_s":0.002969,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000901,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002068,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009906,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015527,"completed_at":"2026-08-11T09:42:07.772Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1476gitlab # [ 169.523117] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:07.774Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b7f082947d1cb617c864b88","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b7f082947d1cb617c864b88: start","job_status":"start","queue_duration_s":4.876779,"scheduling_latency_s":4.876801}1477gitlab # [ 169.542826] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:07.789Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b7f082947d1cb617c864b88","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b7f082947d1cb617c864b88: done: 0.015586 sec","job_status":"done","queue_duration_s":4.876779,"scheduling_latency_s":4.876801,"redis_calls":13,"redis_duration_s":0.0029579999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000943,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002015,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009529,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015586,"completed_at":"2026-08-11T09:42:07.789Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1478gitlab # [ 169.663122] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:07.791Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e553f4cbf66f98fe01481919","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e553f4cbf66f98fe01481919: start","job_status":"start","queue_duration_s":4.89435,"scheduling_latency_s":4.894372}1479gitlab # [ 169.664273] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:07.807Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e553f4cbf66f98fe01481919","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e553f4cbf66f98fe01481919: done: 0.015744 sec","job_status":"done","queue_duration_s":4.89435,"scheduling_latency_s":4.894372,"redis_calls":13,"redis_duration_s":0.003017,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000918,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002099,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009976,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015744,"completed_at":"2026-08-11T09:42:07.807Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1480gitlab # [ 169.684100] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:07.808Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6161e5aa42e420006574051","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6161e5aa42e420006574051: start","job_status":"start","queue_duration_s":4.911567,"scheduling_latency_s":4.911588}1481gitlab # [ 169.703831] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:07.824Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6161e5aa42e420006574051","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6161e5aa42e420006574051: done: 0.015765 sec","job_status":"done","queue_duration_s":4.911567,"scheduling_latency_s":4.911588,"redis_calls":13,"redis_duration_s":0.002966,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000937,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002029,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010063,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015765,"completed_at":"2026-08-11T09:42:07.824Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1482gitlab # [ 169.804964] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:07.826Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a29e8b7208ee450b621f951","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a29e8b7208ee450b621f951: start","job_status":"start","queue_duration_s":4.928679,"scheduling_latency_s":4.9287}1483gitlab # [ 169.806492] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:07.841Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a29e8b7208ee450b621f951","created_at":"2026-08-11T09:42:02.680Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-92c1e27126174529","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"73b61051f49f7411e76181f1eac38c77","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:02.897Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a29e8b7208ee450b621f951: done: 0.015608 sec","job_status":"done","queue_duration_s":4.928679,"scheduling_latency_s":4.9287,"redis_calls":13,"redis_duration_s":0.0029909999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002057,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010396,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015608,"completed_at":"2026-08-11T09:42:07.841Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1484gitlab # [ 169.845232] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:07.843Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"fecbf771925c0b24554ba80f","created_at":"2026-08-11T09:42:02.912Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7dbe8b2de1f9dacdeeba16ec6c203fa2","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:03.038Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-fecbf771925c0b24554ba80f: start","job_status":"start","queue_duration_s":4.8046,"scheduling_latency_s":4.804622}1485gitlab # [ 169.867403] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:08.264Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"fecbf771925c0b24554ba80f","created_at":"2026-08-11T09:42:02.912Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7dbe8b2de1f9dacdeeba16ec6c203fa2","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:03.038Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-fecbf771925c0b24554ba80f: done: 0.421335 sec","job_status":"done","queue_duration_s":4.8046,"scheduling_latency_s":4.804622,"redis_calls":574,"redis_duration_s":0.13220300000000001,"redis_read_bytes":573,"redis_write_bytes":49866,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000504,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001468,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":566,"redis_shared_state_duration_s":0.130231,"redis_shared_state_read_bytes":567,"redis_shared_state_write_bytes":49017,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.322306,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00051962,"duration_s":0.421335,"completed_at":"2026-08-11T09:42:08.264Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000617,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1486gitlab # [ 169.946357] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:08.266Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"514bd8007ab7866a804a2d20","created_at":"2026-08-11T09:42:03.064Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1d55b8e7cd2fe7b3175ec500e12fe070","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:03.083Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-514bd8007ab7866a804a2d20: start","job_status":"start","queue_duration_s":5.182556,"scheduling_latency_s":5.182578}1487gitlab # [ 169.954418] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:08.286Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"514bd8007ab7866a804a2d20","created_at":"2026-08-11T09:42:03.064Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1d55b8e7cd2fe7b3175ec500e12fe070","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:03.083Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-514bd8007ab7866a804a2d20: done: 0.019913 sec","job_status":"done","queue_duration_s":5.182556,"scheduling_latency_s":5.182578,"redis_calls":10,"redis_duration_s":0.002404,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000494,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001418,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000492,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011101,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000393067,"duration_s":0.019913,"completed_at":"2026-08-11T09:42:08.286Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000666,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1488gitlab # [ 170.021639] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:08.287Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"9b23e5ef0b5ca7426dd51ee3","created_at":"2026-08-11T09:42:03.110Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ac675d27724df18a4fab4ee0be17f5e2","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:03.126Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-9b23e5ef0b5ca7426dd51ee3: start","job_status":"start","queue_duration_s":5.160804,"scheduling_latency_s":5.160825}1489gitlab # [ 170.044959] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:08.315Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"9b23e5ef0b5ca7426dd51ee3","created_at":"2026-08-11T09:42:03.110Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ac675d27724df18a4fab4ee0be17f5e2","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:03.126Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-9b23e5ef0b5ca7426dd51ee3: done: 0.02766 sec","job_status":"done","queue_duration_s":5.160804,"scheduling_latency_s":5.160825,"redis_calls":13,"redis_duration_s":0.003055,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000448,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001615,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000992,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017056,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.008495492,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.02766,"completed_at":"2026-08-11T09:42:08.315Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003253,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1490gitlab # [ 170.115139] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:08.316Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"d804529c3eef2df2a0cba4c1","created_at":"2026-08-11T09:42:03.144Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"02dc3dd367e0d5b2b7f649fbdaed312d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:03.156Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-d804529c3eef2df2a0cba4c1: start","job_status":"start","queue_duration_s":5.160191,"scheduling_latency_s":5.160213}1491gitlab # [ 170.138156] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:08.326Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1492gitlab # [ 170.143595] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:08.333Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"d804529c3eef2df2a0cba4c1","created_at":"2026-08-11T09:42:03.144Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"02dc3dd367e0d5b2b7f649fbdaed312d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:03.156Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-d804529c3eef2df2a0cba4c1: done: 0.016742 sec","job_status":"done","queue_duration_s":5.160191,"scheduling_latency_s":5.160213,"redis_calls":10,"redis_duration_s":0.00244,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000449,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001483,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000508,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009577,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000411505,"duration_s":0.016742,"completed_at":"2026-08-11T09:42:08.333Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000422,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1493gitlab # [ 170.232455] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:08.334Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ExpireBuildArtifactsWorker","jid":"4ab3329b3698d22c4efdfe95","created_at":"2026-08-11T09:42:03.188Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"088d08acf7f1325ed8100bffb9edaac2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:7be9ea93da0bda6381b334cf2932692b41842a57ea0aeac11899369225b9bb7e","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:03.215Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"ExpireBuildArtifactsWorker JID-4ab3329b3698d22c4efdfe95: start","job_status":"start","queue_duration_s":5.119515,"scheduling_latency_s":5.119535}1494gitlab # [ 170.233995] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:08.354Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ExpireBuildArtifactsWorker","jid":"4ab3329b3698d22c4efdfe95","created_at":"2026-08-11T09:42:03.188Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"088d08acf7f1325ed8100bffb9edaac2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:7be9ea93da0bda6381b334cf2932692b41842a57ea0aeac11899369225b9bb7e","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:03.215Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"ExpireBuildArtifactsWorker JID-4ab3329b3698d22c4efdfe95: done: 0.019549 sec","job_status":"done","queue_duration_s":5.119515,"scheduling_latency_s":5.119535,"redis_calls":10,"redis_duration_s":0.002312,"redis_read_bytes":9,"redis_write_bytes":1035,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000451,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001372,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000489,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009473,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000357588,"duration_s":0.019549,"completed_at":"2026-08-11T09:42:08.354Z","load_balancing_strategy":"primary","db_duration_s":0.002089,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1495gitlab # [ 170.301418] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:08.355Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"27b9cfe50f068410a5055bf3","created_at":"2026-08-11T09:42:03.244Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e20c997c45e00ee88f561742da9acc5b","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:03.253Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-27b9cfe50f068410a5055bf3: start","job_status":"start","queue_duration_s":5.102223,"scheduling_latency_s":5.102245}1496gitlab # [ 170.371104] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:08.377Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"27b9cfe50f068410a5055bf3","created_at":"2026-08-11T09:42:03.244Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e20c997c45e00ee88f561742da9acc5b","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:03.253Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-27b9cfe50f068410a5055bf3: done: 0.022463 sec","job_status":"done","queue_duration_s":5.102223,"scheduling_latency_s":5.102245,"redis_calls":12,"redis_duration_s":0.003025,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000451,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001578,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000996,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011343,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000467657,"exclusive_lock_hold_duration_s":0.0046081279999999995,"duration_s":0.022463,"completed_at":"2026-08-11T09:42:08.377Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003991,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1497gitlab # [ 170.378954] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:08.379Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"84aa1d2233c53a05a5fc3b31","created_at":"2026-08-11T09:42:03.286Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"086465ba9336f3be26608b301b8c3804","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:03.297Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-84aa1d2233c53a05a5fc3b31: start","job_status":"start","queue_duration_s":5.082266,"scheduling_latency_s":5.082287}1498gitlab # [ 170.401300] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:08.405Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"84aa1d2233c53a05a5fc3b31","created_at":"2026-08-11T09:42:03.286Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"086465ba9336f3be26608b301b8c3804","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:03.297Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-84aa1d2233c53a05a5fc3b31: done: 0.026336 sec","job_status":"done","queue_duration_s":5.082266,"scheduling_latency_s":5.082287,"redis_calls":10,"redis_duration_s":0.00255,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00063,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001462,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000458,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011661,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000388318,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.026336,"completed_at":"2026-08-11T09:42:08.405Z","load_balancing_strategy":"primary","db_duration_s":0.007332,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1499gitlab # [ 170.512237] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:08.407Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"841cc29404e2d55b906f68c6","created_at":"2026-08-11T09:42:03.320Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4bf9ac22466f83bc6b41af8276dd942f","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:03.328Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-841cc29404e2d55b906f68c6: start","job_status":"start","queue_duration_s":5.078196,"scheduling_latency_s":5.078216}1500gitlab # [ 170.513871] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:08.427Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"841cc29404e2d55b906f68c6","created_at":"2026-08-11T09:42:03.320Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4bf9ac22466f83bc6b41af8276dd942f","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:03.328Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-841cc29404e2d55b906f68c6: done: 0.020317 sec","job_status":"done","queue_duration_s":5.078196,"scheduling_latency_s":5.078216,"redis_calls":12,"redis_duration_s":0.002814,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.0005,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000436,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001421,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000457,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010897,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000346692,"duration_s":0.020317,"completed_at":"2026-08-11T09:42:08.427Z","load_balancing_strategy":"primary","db_duration_s":0.000453,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1501gitlab # [ 170.554055] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:08.428Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"be529bd3985d896962ceed46","created_at":"2026-08-11T09:42:03.342Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b61bcc3f785371fc803c0db0b412a000","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:03.350Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-be529bd3985d896962ceed46: start","job_status":"start","queue_duration_s":5.077923,"scheduling_latency_s":5.077945}1502gitlab # [ 170.814812] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:09.765Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"be529bd3985d896962ceed46","created_at":"2026-08-11T09:42:03.342Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b61bcc3f785371fc803c0db0b412a000","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:03.350Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-be529bd3985d896962ceed46: done: 1.336867 sec","job_status":"done","queue_duration_s":5.077923,"scheduling_latency_s":5.077945,"redis_calls":14,"redis_duration_s":0.005419,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00088,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002788,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001751,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.015,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028479,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000500343,"exclusive_lock_hold_duration_s":1.313372509,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":1.336867,"completed_at":"2026-08-11T09:42:09.765Z","load_balancing_strategy":"primary_no_wal","db_duration_s":1.30314,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1503gitlab # [ 170.917428] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:09.868Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"81bfc0792ff57f1c7a60d475","created_at":"2026-08-11T09:42:03.359Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"50d59aa0a0e95a6f9fcccd95d7aacb14","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:03.364Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-81bfc0792ff57f1c7a60d475: start","job_status":"start","queue_duration_s":6.503566,"scheduling_latency_s":6.50367}1504gitlab # [ 171.171969] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:10.122Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"81bfc0792ff57f1c7a60d475","created_at":"2026-08-11T09:42:03.359Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"50d59aa0a0e95a6f9fcccd95d7aacb14","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:03.364Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-81bfc0792ff57f1c7a60d475: done: 0.254745 sec","job_status":"done","queue_duration_s":6.503566,"scheduling_latency_s":6.50367,"redis_calls":14,"redis_duration_s":0.008227,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002385,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003277,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002565,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":125,"db_write_count":0,"db_cached_count":80,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":125,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":80,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.052,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":125,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":80,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.052,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.166811,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001384813,"exclusive_lock_hold_duration_s":0.20722438199999998,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.254745,"completed_at":"2026-08-11T09:42:10.122Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.084787,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1505gitlab # [ 171.272282] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:10.223Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"7257ddd170760dab99cb2c8a","created_at":"2026-08-11T09:42:03.379Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c40c0c9124855648ee01a53d65fe6d86","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:03.385Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-7257ddd170760dab99cb2c8a: start","job_status":"start","queue_duration_s":6.837713,"scheduling_latency_s":6.83779}1506gitlab # [ 171.349177] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:10.299Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"7257ddd170760dab99cb2c8a","created_at":"2026-08-11T09:42:03.379Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c40c0c9124855648ee01a53d65fe6d86","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:03.385Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-7257ddd170760dab99cb2c8a: done: 0.076446 sec","job_status":"done","queue_duration_s":6.837713,"scheduling_latency_s":6.83779,"redis_calls":12,"redis_duration_s":0.0067469999999999995,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001135,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003094,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002518,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032812,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001488178,"exclusive_lock_hold_duration_s":0.012190097,"duration_s":0.076446,"completed_at":"2026-08-11T09:42:10.299Z","load_balancing_strategy":"primary","db_duration_s":0.006,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1507gitlab # [ 171.427140] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:10.377Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"54a9e56892a21ff1def60a53","created_at":"2026-08-11T09:42:03.769Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-2226d8d76f084dc5","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"237385aed425c08d07fa83f53432205f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:03.779Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-54a9e56892a21ff1def60a53: start","job_status":"start","queue_duration_s":6.598475,"scheduling_latency_s":6.598551}1508gitlab # [ 171.466459] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:10.417Z","message":"No existing merge request to be cleaned up."}1509gitlab # [ 171.493148] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:10.444Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"54a9e56892a21ff1def60a53","created_at":"2026-08-11T09:42:03.769Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-2226d8d76f084dc5","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"237385aed425c08d07fa83f53432205f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:03.779Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-54a9e56892a21ff1def60a53: done: 0.066529 sec","job_status":"done","queue_duration_s":6.598475,"scheduling_latency_s":6.598551,"redis_calls":13,"redis_duration_s":0.011122,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001321,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002707,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.007094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037389,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000834464,"duration_s":0.066529,"completed_at":"2026-08-11T09:42:10.443Z","load_balancing_strategy":"primary","db_duration_s":0.007886,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1510gitlab # [ 171.560562] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:10.511Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"590208402bef3b7b0b46a522","created_at":"2026-08-11T09:42:03.769Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-2226d8d76f084dc5","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"237385aed425c08d07fa83f53432205f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:03.779Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-590208402bef3b7b0b46a522: start","job_status":"start","queue_duration_s":6.732125,"scheduling_latency_s":6.7322}1511gitlab # [ 171.587663] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:10.539Z","message":"No existing merge request to be cleaned up."}1512gitlab # [ 171.605973] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:10.556Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"590208402bef3b7b0b46a522","created_at":"2026-08-11T09:42:03.769Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-2226d8d76f084dc5","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"237385aed425c08d07fa83f53432205f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:03.779Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-590208402bef3b7b0b46a522: done: 0.045595 sec","job_status":"done","queue_duration_s":6.732125,"scheduling_latency_s":6.7322,"redis_calls":10,"redis_duration_s":0.008483000000000001,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002117,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.006366,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026504,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.045595,"completed_at":"2026-08-11T09:42:10.556Z","load_balancing_strategy":"primary","db_duration_s":0.003169,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1513gitlab # [ 171.670222] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:10.621Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ebc742d4842b2ca3e830d2f2","created_at":"2026-08-11T09:42:03.769Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-2226d8d76f084dc5","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"237385aed425c08d07fa83f53432205f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:03.779Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ebc742d4842b2ca3e830d2f2: start","job_status":"start","queue_duration_s":6.841822,"scheduling_latency_s":6.841898}1514gitlab # [ 171.699173] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:10.650Z","message":"No existing merge request to be cleaned up."}1515gitlab # [ 171.716339] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:10.667Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ebc742d4842b2ca3e830d2f2","created_at":"2026-08-11T09:42:03.769Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-2226d8d76f084dc5","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"237385aed425c08d07fa83f53432205f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:03.779Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ebc742d4842b2ca3e830d2f2: done: 0.046328 sec","job_status":"done","queue_duration_s":6.841822,"scheduling_latency_s":6.841898,"redis_calls":10,"redis_duration_s":0.007623,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001911,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.005712,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026799,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.046328,"completed_at":"2026-08-11T09:42:10.666Z","load_balancing_strategy":"primary","db_duration_s":0.00422,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1516gitlab # [ 171.781389] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:10.732Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"257a3470dea6cd27cab63ee0","created_at":"2026-08-11T09:42:03.769Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-2226d8d76f084dc5","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"237385aed425c08d07fa83f53432205f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:03.779Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-257a3470dea6cd27cab63ee0: start","job_status":"start","queue_duration_s":6.952984,"scheduling_latency_s":6.953075}1517gitlab # [ 171.808553] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:10.759Z","message":"No existing merge request to be cleaned up."}1518gitlab # [ 171.825799] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:10.776Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"257a3470dea6cd27cab63ee0","created_at":"2026-08-11T09:42:03.769Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-2226d8d76f084dc5","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"237385aed425c08d07fa83f53432205f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:03.779Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-257a3470dea6cd27cab63ee0: done: 0.044881 sec","job_status":"done","queue_duration_s":6.952984,"scheduling_latency_s":6.953075,"redis_calls":10,"redis_duration_s":0.005843,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002091,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003752,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024614,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.044881,"completed_at":"2026-08-11T09:42:10.776Z","load_balancing_strategy":"primary","db_duration_s":0.003861,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1519gitlab # [ 179.221641] setup-gitlab-start[2769]: W, [2026-08-11T09:42:18.172116 #2769] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1520gitlab # [ 202.198169] runuser[2768]: pam_unix(runuser:session): session closed for user gitlab1521gitlab # [ 202.202509] setup-gitlab-start[2988]: ++ jq -r .token1522gitlab # [ 202.204868] setup-gitlab-start[2989]: +++ date -d '+7 days' +%F1523gitlab # [ 202.209126] setup-gitlab-start[2987]: ++ curl -fs -X POST -H 'Authorization: Bearer 61162ccb81f6bf55d09da26ecc6a2666d9c9b04cf41193931719f9d57d7a218c' -H 'Content-Type: application/json' -d '{"name":"nixbot","scopes":["api"],"expires_at":"2026-08-18"}' http://gitlab/api/v4/users/1/personal_access_tokens1524gitlab # [ 202.610749] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:41.560Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"f40c73ede5fc1544f62dcc49","created_at":"2026-08-11T09:42:41.505Z","trace_propagation_headers":{"sentry-trace":"1755637edba541f8bb96f26e9744fbeb-dfb961af4db34ecf","baggage":"sentry-trace_id=1755637edba541f8bb96f26e9744fbeb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR37SRX80K1QBQYGDESB5PR","meta.caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"system_access","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:1cbc359d3293aa4df3cab924cfac11eb40ad08ac2e5612c5090619896971fc8b","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:41.555Z","job_size_bytes":451,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-f40c73ede5fc1544f62dcc49: start","job_status":"start","queue_duration_s":0.005125,"scheduling_latency_s":0.0052}1525gitlab # [ 202.618506] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:42:41 +0000] "POST /api/v4/users/1/personal_access_tokens HTTP/1.1" 201 267 "" "curl/8.20.0" 3871526gitlab # [ 202.676970] setup-gitlab-start[2717]: + TOKEN=glpat-rhukvm8O5MiqbsB6o9ApCW86MQp1OjEH.01.0w0pmb9491527gitlab # [ 202.679160] setup-gitlab-start[2717]: + test -n glpat-rhukvm8O5MiqbsB6o9ApCW86MQp1OjEH.01.0w0pmb9491528gitlab # [ 202.680937] setup-gitlab-start[2717]: + test glpat-rhukvm8O5MiqbsB6o9ApCW86MQp1OjEH.01.0w0pmb949 '!=' null1529gitlab # [ 202.682511] setup-gitlab-start[2717]: + mkdir -p /var/lib/secrets1530gitlab # [ 202.684338] setup-gitlab-start[2717]: + echo glpat-rhukvm8O5MiqbsB6o9ApCW86MQp1OjEH.01.0w0pmb9491531gitlab # [ 202.685920] setup-gitlab-start[2717]: + chmod 644 /var/lib/secrets/gitlab-token1532gitlab # [ 202.687639] setup-gitlab-start[2717]: + curl -fs -X POST -H 'PRIVATE-TOKEN: glpat-rhukvm8O5MiqbsB6o9ApCW86MQp1OjEH.01.0w0pmb949' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1533gitlab # [ 202.835613] sidekiq-cluster[2141]: {"severity":"WARN","time":"2026-08-11T09:42:41.785Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"f40c73ede5fc1544f62dcc49","created_at":"2026-08-11T09:42:41.505Z","trace_propagation_headers":{"sentry-trace":"1755637edba541f8bb96f26e9744fbeb-dfb961af4db34ecf","baggage":"sentry-trace_id=1755637edba541f8bb96f26e9744fbeb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR37SRX80K1QBQYGDESB5PR","meta.caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"system_access","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:1cbc359d3293aa4df3cab924cfac11eb40ad08ac2e5612c5090619896971fc8b","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:41.555Z","job_size_bytes":451,"pid":2141,"sidekiq_tid":"lys9","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-f40c73ede5fc1544f62dcc49: fail: 0.224439 sec","job_status":"fail","queue_duration_s":0.005125,"scheduling_latency_s":0.0052,"redis_calls":11,"redis_duration_s":0.003355,"redis_read_bytes":137,"redis_write_bytes":1317,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001036,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":433,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00171,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000609,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.095814,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000382172,"duration_s":0.224439,"completed_at":"2026-08-11T09:42:41.784Z","load_balancing_strategy":"primary_no_wal","exception.class":"ArgumentError","exception.message":":arguments expected to be an Array of individual string args","exception.backtrace":["/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/network/delivery_methods/sendmail.rb:53:in `initialize'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `new'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `delivery_method'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:66:in `wrap_delivery_behavior'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:80:in `wrap_delivery_behavior!'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:876:in `mail'","app/mailers/application_mailer.rb:85:in `block in mail_with_locale'","lib/gitlab/i18n.rb:116:in `with_locale'","app/mailers/application_mailer.rb:84:in `mail_with_locale'","app/mailers/notify.rb:293:in `email_with_layout'","app/mailers/emails/profile.rb:99:in `access_token_created_email'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:215:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:261:in `block in process_action'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","lib/gitlab/i18n.rb:116:in `with_locale'","lib/gitlab/i18n.rb:126:in `with_default_locale'","app/mailers/application_mailer.rb:60:in `render_with_default_locale'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:260:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:152:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:29:in `block in process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:21:in `handle_exceptions'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:28:in `process'","/nix/store/abbaw4w9gll6p923md75p3h3rrmhrdqn-ruby3.3-actionview-7.2.3/lib/ruby/gems/3.3.0/gems/actionview-7.2.3/lib/action_view/rendering.rb:40:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:652:in `block in process'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:651:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:136:in `block in processed_mailer'","\u003cinternal:kernel\u003e:90:in `tap'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:135:in `processed_mailer'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:124:in `deliver_now'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/mail_delivery_job.rb:28:in `perform'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:68:in `block in _perform_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/railtie.rb:32:in `block (2 levels) in insert_into_active_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/bqz31s23z0jk4464lbybyz83ikl0gmyd-ruby3.3-i18n-1.14.7/lib/ruby/gems/3.3.0/gems/i18n-1.14.7/lib/i18n.rb:353:in `with_locale'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/translation.rb:9:in `block (2 levels) in \u003cmodule:Translation\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/core_ext/time/zones.rb:65:in `use_zone'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/timezones.rb:9:in `block (2 levels) in \u003cmodule:Timezones\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:67:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:32:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:51:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `block in perform_now'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:13:in `block in instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:40:in `block in instrument'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:39:in `instrument'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:11:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `block in perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:41:in `tag_logger'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `perform_now'","/nix/store/wp2rnxa243q2gn2f8h04d48hnvfr0387-ruby3.3-sentry-rails-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-rails-5.23.0/lib/sentry/rails/active_job.rb:8:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:29:in `block in execute'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:79:in `block (4 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:87:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:78:in `block (3 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:27:in `execute'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:13:in `perform'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:220:in `execute_job'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:185:in `block (4 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/current_organization/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/identity/restore.rb:12:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/resource_usage_limit/middleware.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/resource_usage_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/database/load_balancing/sidekiq_server_middleware.rb:35:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/skip_jobs.rb:51:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/throttling/middleware.rb:18:in `perform'","lib/gitlab/sidekiq_middleware/throttling/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/pause_control/strategies/base.rb:31:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/strategy_handler.rb:22:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/duplicate_jobs/strategies/until_executing.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/duplicate_job.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/concurrency_limit/middleware.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/concurrency_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/click_house/migration_support/sidekiq_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/worker_context.rb:9:in `wrap_in_optional_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:19:in `block in call'","lib/gitlab/application_context.rb:185:in `block in use'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","lib/gitlab/application_context.rb:185:in `use'","lib/gitlab/application_context.rb:105:in `with_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:17:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_status/server_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_versioning/middleware.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `block in call'","lib/gitlab/database/query_analyzer.rb:94:in `within'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/admin_mode/server.rb:14:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/set_ip_address.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/instrumentation_logger.rb:10:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/batch_loader.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/extra_done_log_metadata.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/server_metrics.rb:112:in `block in call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `block in instrument'","lib/gitlab/metrics/background_transaction.rb:33:in `run'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `instrument'","lib/gitlab/sidekiq_middleware/server_metrics.rb:111:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:8:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:66:in `enabling_request_store'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:59:in `ensure_request_store'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:22:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/user_experience_sli/server.rb:16:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:16:in `block in call'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:15:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/monitor.rb:10:in `block in call'","lib/gitlab/sidekiq_daemon/monitor.rb:46:in `within_job'","lib/gitlab/sidekiq_middleware/monitor.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:10:in `block in call'","lib/gitlab/sidekiq_sharding/validator.rb:42:in `enabled'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/size_limiter/server.rb:13:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/sidekiq_instrumentation.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/85h4805ad7n5qn7wq2m6icypga7rnk80-ruby3.3-sentry-sidekiq-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-sidekiq-5.23.0/lib/sentry/sidekiq/sentry_context_middleware.rb:54:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job/interrupt_handler.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:26:in `track'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:134:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:184:in `block (3 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:145:in `block (6 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:118:in `local'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:144:in `block (5 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:27:in `block in call'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:91:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:26:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:139:in `block (4 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:281:in `stats'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:134:in `block (3 levels) in dispatch'","lib/gitlab/sidekiq_logging/structured_logger.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:133:in `block (2 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:85:in `global'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:132:in `block in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_logger.rb:40:in `prepare'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:131:in `dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:183:in `block (2 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `block in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:86:in `process_one'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:76:in `run'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:10:in `watchdog'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:19:in `block in safe_thread'"],"db_duration_s":0.029735,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1534gitlab # [ 204.458405] gitaly[1381]: time="2026-08-11T09:42:43.408Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KZR37T7HCV1FH64ERASCX80T error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T09:42:53.007" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T09:42:43.408" pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1535gitlab # [ 204.461356] gitaly[1381]: time="2026-08-11T09:42:43.409Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR37T7HCV1FH64ERASCX80T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T09:42:53.007" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T09:42:43.408" grpc.time_ms=0.789 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1536gitlab # [ 204.611609] gitaly[1381]: time="2026-08-11T09:42:43.562Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KZR37T7HCV1FH64ERASCX80T error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T09:42:53.161" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T09:42:43.562" pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1537gitlab # [ 204.651289] gitaly[1381]: time="2026-08-11T09:42:43.563Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR37T7HCV1FH64ERASCX80T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T09:42:53.161" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T09:42:43.562" grpc.time_ms=0.594 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1538gitlab # [ 204.701153] gitaly[1381]: time="2026-08-11T09:42:43.652Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR37T7HCV1FH64ERASCX80T diskcache=419b513b-12a1-4907-8cb6-21f1bb367870 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-11T09:42:53.173" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T09:42:43.573" pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1539gitlab # [ 204.703338] gitaly[1381]: time="2026-08-11T09:42:43.653Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=326 command.oublock=32 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR37T7HCV1FH64ERASCX80T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-11T09:42:53.173" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T09:42:43.573" grpc.time_ms=78.716 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1540gitlab # [ 204.722477] gitaly[1381]: time="2026-08-11T09:42:43.673Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KZR37T7HCV1FH64ERASCX80T grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T09:42:53.271" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T09:42:43.672" pid=1381 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1541gitlab # [ 204.724255] gitaly[1381]: time="2026-08-11T09:42:43.674Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR37T7HCV1FH64ERASCX80T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T09:42:53.271" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T09:42:43.672" grpc.time_ms=1.128 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1542gitlab # [ 204.743189] gitaly[1381]: time="2026-08-11T09:42:43.694Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR37T7HCV1FH64ERASCX80T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T09:42:53.279" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T09:42:43.680" grpc.time_ms=13.73 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1543gitlab # [ 204.776540] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:43.726Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"10f5540f99bfe176fe93edd3","created_at":"2026-08-11T09:42:43.708Z","trace_propagation_headers":{"sentry-trace":"22eba4911c5941a299133154e798075d-04b962dfaf3a4149","baggage":"sentry-trace_id=22eba4911c5941a299133154e798075d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR37T7HCV1FH64ERASCX80T","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:43.723Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-10f5540f99bfe176fe93edd3: start","job_status":"start","queue_duration_s":0.003304,"scheduling_latency_s":0.003384}1544gitlab # [ 204.790280] gitaly[1381]: time="2026-08-11T09:42:43.741Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KZR37T7HCV1FH64ERASCX80T error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T09:42:53.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T09:42:43.741" pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1545gitlab # [ 204.792081] gitaly[1381]: time="2026-08-11T09:42:43.743Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR37T7HCV1FH64ERASCX80T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T09:42:53.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T09:42:43.741" grpc.time_ms=0.528 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1546gitlab # [ 204.828337] gitaly[1381]: time="2026-08-11T09:42:43.779Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR37T7HCV1FH64ERASCX80T diskcache=7e66cab0-7518-425f-812a-ccfbdb3ec604 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-11T09:42:53.016" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T09:42:43.747" pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1547gitlab # [ 204.829887] gitaly[1381]: time="2026-08-11T09:42:43.780Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=323 command.oublock=32 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR37T7HCV1FH64ERASCX80T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-11T09:42:53.016" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T09:42:43.747" grpc.time_ms=32.986 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1548gitlab # [ 204.840107] gitaly[1381]: time="2026-08-11T09:42:43.791Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KZR37T7HCV1FH64ERASCX80T grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T09:42:53.060" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T09:42:43.791" pid=1381 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1549gitlab # [ 204.840891] gitaly[1381]: time="2026-08-11T09:42:43.791Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR37T7HCV1FH64ERASCX80T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T09:42:53.060" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T09:42:43.791" grpc.time_ms=0.534 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1550gitlab # [ 204.913483] gitaly[1381]: time="2026-08-11T09:42:43.809Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZR37T7HCV1FH64ERASCX80T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T09:42:53.068" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T09:42:43.799" grpc.time_ms=9.918 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1551gitlab # [ 204.914964] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:43.815Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"10f5540f99bfe176fe93edd3","created_at":"2026-08-11T09:42:43.708Z","trace_propagation_headers":{"sentry-trace":"22eba4911c5941a299133154e798075d-04b962dfaf3a4149","baggage":"sentry-trace_id=22eba4911c5941a299133154e798075d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR37T7HCV1FH64ERASCX80T","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:43.723Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-10f5540f99bfe176fe93edd3: done: 0.089062 sec","job_status":"done","queue_duration_s":0.003304,"scheduling_latency_s":0.003384,"redis_calls":12,"redis_duration_s":0.006012,"redis_read_bytes":10,"redis_write_bytes":1430,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000751,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":265,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003361,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.0019,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055924,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.046772425,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.089062,"completed_at":"2026-08-11T09:42:43.815Z","load_balancing_strategy":"primary","db_duration_s":0.014565,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1552gitlab # [ 204.996972] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:43.817Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"8127608f10c9fdf4c961d1f9","created_at":"2026-08-11T09:42:43.729Z","trace_propagation_headers":{"sentry-trace":"22eba4911c5941a299133154e798075d-04b962dfaf3a4149","baggage":"sentry-trace_id=22eba4911c5941a299133154e798075d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR37T7HCV1FH64ERASCX80T","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:43.736Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-8127608f10c9fdf4c961d1f9: start","job_status":"start","queue_duration_s":0.081745,"scheduling_latency_s":0.081806}1553gitlab # [ 204.998419] gitaly[1381]: time="2026-08-11T09:42:43.835Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR37T7HCV1FH64ERASCX80T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T09:42:53.104" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T09:42:43.835" grpc.time_ms=0.135 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1554gitlab # [ 204.999403] gitaly[1381]: time="2026-08-11T09:42:43.842Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR37T7HCV1FH64ERASCX80T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-11T09:42:53.111" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T09:42:43.841" grpc.time_ms=0.292 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1555gitlab # [ 205.002258] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:43.909Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"8127608f10c9fdf4c961d1f9","created_at":"2026-08-11T09:42:43.729Z","trace_propagation_headers":{"sentry-trace":"22eba4911c5941a299133154e798075d-04b962dfaf3a4149","baggage":"sentry-trace_id=22eba4911c5941a299133154e798075d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR37T7HCV1FH64ERASCX80T","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:43.736Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-8127608f10c9fdf4c961d1f9: done: 0.091317 sec","job_status":"done","queue_duration_s":0.081745,"scheduling_latency_s":0.081806,"redis_calls":14,"redis_duration_s":0.004468,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000929,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002395,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001144,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.058758,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.06440623000000001,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.091317,"completed_at":"2026-08-11T09:42:43.908Z","load_balancing_strategy":"primary","db_duration_s":0.022467,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1556gitlab # [ 205.079322] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:44.010Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"47dd4c7b6fe93fb4d1d970ec","created_at":"2026-08-11T09:42:44.002Z","trace_propagation_headers":{"sentry-trace":"22eba4911c5941a299133154e798075d-04b962dfaf3a4149","baggage":"sentry-trace_id=22eba4911c5941a299133154e798075d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR37T7HCV1FH64ERASCX80T","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:44.008Z","job_size_bytes":5,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-47dd4c7b6fe93fb4d1d970ec: start","job_status":"start","queue_duration_s":0.001552,"scheduling_latency_s":0.001594}1557gitlab # [ 205.105607] gitaly[1381]: time="2026-08-11T09:42:44.057Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR37T7HCV1FH64ERASCX80T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T09:42:54.010" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T09:42:44.050" grpc.time_ms=6.032 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1558gitlab # [ 205.162140] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:44.113Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"47dd4c7b6fe93fb4d1d970ec","created_at":"2026-08-11T09:42:44.002Z","trace_propagation_headers":{"sentry-trace":"22eba4911c5941a299133154e798075d-04b962dfaf3a4149","baggage":"sentry-trace_id=22eba4911c5941a299133154e798075d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR37T7HCV1FH64ERASCX80T","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:44.008Z","job_size_bytes":5,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-47dd4c7b6fe93fb4d1d970ec: done: 0.103375 sec","job_status":"done","queue_duration_s":0.001552,"scheduling_latency_s":0.001594,"redis_calls":12,"redis_duration_s":0.003424,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000768,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001988,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000668,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.06774,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000389156,"duration_s":0.103375,"completed_at":"2026-08-11T09:42:44.113Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02367,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1559gitlab # [ 205.193605] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:44.115Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"7b0ba477866a9c1fc848be1f","created_at":"2026-08-11T09:42:44.029Z","trace_propagation_headers":{"sentry-trace":"22eba4911c5941a299133154e798075d-04b962dfaf3a4149","baggage":"sentry-trace_id=22eba4911c5941a299133154e798075d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR37T7HCV1FH64ERASCX80T","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:44.033Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-7b0ba477866a9c1fc848be1f: start","job_status":"start","queue_duration_s":0.081932,"scheduling_latency_s":0.081955}1560gitlab # [ 205.518460] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:42:44 +0000] "POST /api/v4/projects HTTP/1.1" 201 4795 "" "curl/8.20.0" 28181561gitlab # [ 205.526985] setup-gitlab-start[2717]: + mkdir -p /tmp/test-flake1562gitlab # [ 205.529898] setup-gitlab-start[2717]: + cd /tmp/test-flake1563gitlab # [ 205.531128] setup-gitlab-start[2717]: + git init -b master1564gitlab # [ 205.542511] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:44.493Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"7b0ba477866a9c1fc848be1f","created_at":"2026-08-11T09:42:44.029Z","trace_propagation_headers":{"sentry-trace":"22eba4911c5941a299133154e798075d-04b962dfaf3a4149","baggage":"sentry-trace_id=22eba4911c5941a299133154e798075d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR37T7HCV1FH64ERASCX80T","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:44.033Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-7b0ba477866a9c1fc848be1f: done: 0.378617 sec","job_status":"done","queue_duration_s":0.081932,"scheduling_latency_s":0.081955,"redis_calls":11,"redis_duration_s":0.005771,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000707,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004438,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000626,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.134,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.341,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.341,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.132,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.173653,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001290108,"duration_s":0.378617,"completed_at":"2026-08-11T09:42:44.493Z","load_balancing_strategy":"primary","db_duration_s":0.201814,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1565gitlab # [ 205.556097] setup-gitlab-start[3033]: Initialized empty Git repository in /tmp/test-flake/.git/1566gitlab # [ 205.558897] setup-gitlab-start[2717]: + git config user.name test1567gitlab # [ 205.561603] setup-gitlab-start[2717]: + git config user.email test@example.com1568gitlab # [ 205.563674] setup-gitlab-start[2717]: + cat1569gitlab # [ 205.565665] setup-gitlab-start[2717]: + git add flake.nix1570gitlab # [ 205.567845] setup-gitlab-start[2717]: + git commit -m 'initial commit'1571gitlab # [ 205.573089] setup-gitlab-start[3038]: [master (root-commit) 075c9ab] initial commit1572gitlab # [ 205.573979] setup-gitlab-start[3038]: 1 file changed, 10 insertions(+)1573gitlab # [ 205.577386] setup-gitlab-start[3038]: create mode 100644 flake.nix1574gitlab # [ 205.579681] setup-gitlab-start[2717]: + git remote add origin http://oauth2:glpat-rhukvm8O5MiqbsB6o9ApCW86MQp1OjEH.01.0w0pmb949@gitlab/root/test-flake.git1575gitlab # [ 205.582359] setup-gitlab-start[2717]: + git push -u origin master1576gitlab # [ 205.659504] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:44.610Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"791ff5a162e82fa9099d2d0b","created_at":"2026-08-11T09:42:44.035Z","trace_propagation_headers":{"sentry-trace":"22eba4911c5941a299133154e798075d-04b962dfaf3a4149","baggage":"sentry-trace_id=22eba4911c5941a299133154e798075d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR37T7HCV1FH64ERASCX80T","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:44.039Z","job_size_bytes":89,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-791ff5a162e82fa9099d2d0b: start","job_status":"start","queue_duration_s":0.570977,"scheduling_latency_s":0.571022}1577gitlab # [ 205.717646] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:44.668Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"791ff5a162e82fa9099d2d0b","created_at":"2026-08-11T09:42:44.035Z","trace_propagation_headers":{"sentry-trace":"22eba4911c5941a299133154e798075d-04b962dfaf3a4149","baggage":"sentry-trace_id=22eba4911c5941a299133154e798075d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR37T7HCV1FH64ERASCX80T","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:44.039Z","job_size_bytes":89,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-791ff5a162e82fa9099d2d0b: done: 0.058488 sec","job_status":"done","queue_duration_s":0.570977,"scheduling_latency_s":0.571022,"redis_calls":11,"redis_duration_s":0.0028669999999999998,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000779,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001545,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000543,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":9,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029056,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000375467,"duration_s":0.058488,"completed_at":"2026-08-11T09:42:44.668Z","load_balancing_strategy":"primary","db_duration_s":0.018712,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1578gitlab # [ 205.755397] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:42:44 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.54.0" 1171579gitlab # [ 205.821325] gitaly[1381]: time="2026-08-11T09:42:44.771Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR37X5YV19ZH8VSHMKFA1AH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T09:42:44.757" grpc.time_ms=13.392 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1580gitlab # [ 205.823257] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:42:44 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.54.0" 1021581gitlab # [ 206.090969] gitaly[1381]: time="2026-08-11T09:42:45.039Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T09:42:55.001" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T09:42:45.022" grpc.time_ms=14.819 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1582gitlab # [ 206.144766] gitaly[1381]: time="2026-08-11T09:42:45.096Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=332 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-11T09:43:15.067" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-11T09:42:45.068" grpc.time_ms=27.726 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1583gitlab # [ 206.161450] gitaly[1381]: time="2026-08-11T09:42:45.113Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP duration_ms=152ns method=POST pid=1381 status=200 url="http://unix/api/v4/internal/allowed"1584gitlab # [ 206.303912] gitaly[1381]: time="2026-08-11T09:42:45.255Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP duration_ms=140ns method=POST pid=1381 status=200 url="http://unix/api/v4/internal/pre_receive"1585gitlab # [ 206.319322] gitaly[1381]: time="2026-08-11T09:42:45.256Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5316 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T09:42:44.960" grpc.time_ms=295.961 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1586gitlab # [ 206.377204] gitaly[1381]: time="2026-08-11T09:42:45.328Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T09:42:45.327" grpc.time_ms=0.654 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1587gitlab # [ 206.417632] gitaly[1381]: time="2026-08-11T09:42:45.369Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T09:42:45.368" grpc.time_ms=0.444 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1588gitlab # [ 206.459548] gitaly[1381]: time="2026-08-11T09:42:45.411Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T09:42:45.410" grpc.time_ms=0.641 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1589gitlab # [ 206.537685] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:45.488Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 075c9ab1f688abeabd7100784bc099321ae5e1e8 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"335c95e4a4218f02147d201b","created_at":"2026-08-11T09:42:45.481Z","trace_propagation_headers":{"sentry-trace":"436e5c49b14f45f6a2b5c1f2d300a03e-61d1e50a65a0405e","baggage":"sentry-trace_id=436e5c49b14f45f6a2b5c1f2d300a03e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR37XA9M0TKCWTANXKQ5AVP","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:45.486Z","job_size_bytes":185,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-335c95e4a4218f02147d201b: start","job_status":"start","queue_duration_s":0.001734,"scheduling_latency_s":0.00178}1590gitlab # [ 206.561841] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:45.513Z","message":"changes: \"0000000000000000000000000000000000000000 075c9ab1f688abeabd7100784bc099321ae5e1e8 refs/heads/master\\n\""}1591gitlab # [ 206.584092] gitaly[1381]: time="2026-08-11T09:42:45.535Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=31 command.spawn_token_fork_ms=25 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T09:42:55.102" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T09:42:45.502" grpc.time_ms=32.279 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1592gitlab # [ 206.610206] gitaly[1381]: time="2026-08-11T09:42:45.561Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=22 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T09:42:55.005" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T09:42:45.536" grpc.time_ms=25.493 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1593gitlab # [ 206.638725] gitaly[1381]: time="2026-08-11T09:42:45.590Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T09:42:55.048" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T09:42:45.578" grpc.time_ms=11.63 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1594gitlab # [ 206.656257] gitaly[1381]: time="2026-08-11T09:42:45.607Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1561 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-11T09:42:55.065" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T09:42:45.595" grpc.time_ms=12.145 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1595gitlab # [ 206.688864] gitaly[1381]: time="2026-08-11T09:42:45.640Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=22 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1568 command.oublock=0 command.real_time_ms=92 command.spawn_token_fork_ms=16 command.system_time_ms=5 command.user_time_ms=17 component=gitaly.UnaryServerInterceptor correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-11T09:42:55.142" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T09:42:45.543" grpc.time_ms=97.2 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1596gitlab # [ 206.693903] gitaly[1381]: time="2026-08-11T09:42:45.645Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=648 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-11T09:42:55.102" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=226 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T09:42:45.633" grpc.time_ms=11.814 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1597gitlab # [ 206.706779] gitaly[1381]: time="2026-08-11T09:42:45.658Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP duration_ms=205ns method=POST pid=1381 status=200 url="http://unix/api/v4/internal/post_receive"1598gitlab # [ 206.707962] gitaly[1381]: time="2026-08-11T09:42:45.658Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4810 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T09:42:45.451" grpc.time_ms=207.116 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1599gitlab # [ 206.762909] gitaly[1381]: time="2026-08-11T09:42:45.714Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3938 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T09:42:45.713" grpc.time_ms=0.413 pid=1381 span.kind=server system=grpc1600gitlab # [ 206.778256] gitaly[1381]: time="2026-08-11T09:42:45.717Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP diskcache=1412267b-5026-4d72-82a7-d807583a7967 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T09:42:44.878" pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1601gitlab # [ 206.779727] gitlab-workhorse[1283]: time="2026-08-11T09:42:45Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521602gitlab # [ 206.780983] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:42:45 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.54.0" 9081603gitlab # [ 206.782154] gitaly[1381]: time="2026-08-11T09:42:45.717Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=263 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=892928 command.minflt=13302 command.oublock=32 command.real_time_ms=826 command.spawn_token_fork_ms=3 command.system_time_ms=198 command.user_time_ms=65 component=gitaly.StreamServerInterceptor correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T09:42:44.878" grpc.time_ms=839.529 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1604gitlab # [ 206.821718] setup-gitlab-start[3042]: To http://gitlab/root/test-flake.git1605gitlab # [ 206.822853] setup-gitlab-start[3042]: * [new branch] master -> master1606gitlab # [ 206.828665] setup-gitlab-start[3042]: branch 'master' set up to track 'origin/master'.1607gitlab # [ 206.832920] systemd[1]: Finished setup-gitlab.service.1608gitlab # [ 206.834844] gitaly[1381]: time="2026-08-11T09:42:45.784Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3940 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T09:42:45.783" grpc.time_ms=0.402 pid=1381 span.kind=server system=grpc1609gitlab # [ 206.837572] systemd[1]: Starting nixbot CI service...1610gitlab # [ 206.860210] gitaly[1381]: time="2026-08-11T09:42:45.811Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP diskcache=64457715-1aa3-4fa7-b252-26723a9fd481 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-11T09:42:55.124" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T09:42:45.655" pid=1381 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1611gitlab # [ 206.876672] gitaly[1381]: time="2026-08-11T09:42:45.812Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=84 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4637 command.oublock=8 command.real_time_ms=148 command.spawn_token_fork_ms=1 command.system_time_ms=61 command.user_time_ms=23 component=gitaly.UnaryServerInterceptor correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-11T09:42:55.124" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T09:42:45.655" grpc.time_ms=156.808 pid=1381 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1612gitlab # [ 206.898831] gitaly[1381]: time="2026-08-11T09:42:45.850Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-11T09:42:55.029" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T09:42:45.850" grpc.time_ms=0.178 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1613gitlab # [ 206.929882] gitaly[1381]: time="2026-08-11T09:42:45.881Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=940 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-11T09:42:55.050" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T09:42:45.871" grpc.time_ms=10.208 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1614gitlab # [ 206.998689] gitaly[1381]: time="2026-08-11T09:42:45.950Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=340 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-11T09:43:15.044" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:45.944" grpc.time_ms=5.157 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1615gitlab # [ 207.026961] gitaly[1381]: time="2026-08-11T09:42:45.978Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-11T09:42:55.156" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T09:42:45.977" grpc.time_ms=0.311 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1616gitlab # [ 207.049116] gitaly[1381]: time="2026-08-11T09:42:46.000Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=344 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-11T09:42:55.175" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-11T09:42:45.995" grpc.time_ms=4.622 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1617gitlab # [ 207.067541] gitaly[1381]: time="2026-08-11T09:42:46.019Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T09:42:56.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T09:42:46.012" grpc.time_ms=6.161 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1618gitlab # [ 207.080959] gitaly[1381]: time="2026-08-11T09:42:46.032Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T09:42:56.015" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T09:42:46.025" grpc.time_ms=6.468 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1619gitlab # [ 207.101328] gitaly[1381]: time="2026-08-11T09:42:46.052Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=971 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-11T09:43:16.042" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:46.043" grpc.time_ms=9.481 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1620gitlab: (finished: waiting for unit setup-gitlab.service, in 208.36 seconds)1621gitlab # [ 207.393670] gitaly[1381]: time="2026-08-11T09:42:46.345Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-11T09:42:56.002" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:46.342" grpc.time_ms=2.129 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1622gitlab: waiting for unit nixbot.service1623gitlab # [ 207.441042] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:46.392Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 075c9ab1f688abeabd7100784bc099321ae5e1e8 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"335c95e4a4218f02147d201b","created_at":"2026-08-11T09:42:45.481Z","trace_propagation_headers":{"sentry-trace":"436e5c49b14f45f6a2b5c1f2d300a03e-61d1e50a65a0405e","baggage":"sentry-trace_id=436e5c49b14f45f6a2b5c1f2d300a03e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR37XA9M0TKCWTANXKQ5AVP","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:45.486Z","job_size_bytes":185,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-335c95e4a4218f02147d201b: done: 0.904321 sec","job_status":"done","queue_duration_s":0.001734,"scheduling_latency_s":0.00178,"gitaly_calls":14,"gitaly_duration_s":0.356037,"redis_calls":211,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.064022,"redis_read_bytes":1694,"redis_write_bytes":20829,"redis_cache_calls":14,"redis_cache_duration_s":0.004065,"redis_cache_read_bytes":16,"redis_cache_write_bytes":884,"redis_feature_flag_calls":42,"redis_feature_flag_duration_s":0.017369,"redis_feature_flag_read_bytes":1312,"redis_feature_flag_write_bytes":5226,"redis_queues_calls":8,"redis_queues_duration_s":0.001484,"redis_queues_read_bytes":8,"redis_queues_write_bytes":4933,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002967,"redis_queues_metadata_read_bytes":11,"redis_queues_metadata_write_bytes":1259,"redis_repository_cache_calls":92,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.020086,"redis_repository_cache_read_bytes":214,"redis_repository_cache_write_bytes":6392,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.018051,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":53,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":53,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.053,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":53,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.205,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.226,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.053,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.407395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000739759,"exclusive_lock_hold_duration_s":0.027683685,"duration_s":0.904321,"completed_at":"2026-08-11T09:42:46.392Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.083803,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1624gitlab # [ 207.523679] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:46.394Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"85390f393c0accfeebd7a1fd","created_at":"2026-08-11T09:42:45.610Z","trace_propagation_headers":{"sentry-trace":"436e5c49b14f45f6a2b5c1f2d300a03e-15345573ab284485","baggage":"sentry-trace_id=436e5c49b14f45f6a2b5c1f2d300a03e,sentry-release=Unknown"},"correlation_id":"01KZR37XA9M0TKCWTANXKQ5AVP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:45.614Z","job_size_bytes":46,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-85390f393c0accfeebd7a1fd: start","job_status":"start","queue_duration_s":0.779378,"scheduling_latency_s":0.779402}1625gitlab # [ 207.550120] gitaly[1381]: time="2026-08-11T09:42:46.443Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-11T15:42:46.440" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T09:42:46.441" grpc.time_ms=2.271 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1626gitlab # [ 207.569410] gitaly[1381]: time="2026-08-11T09:42:46.501Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=648 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-11T09:43:16.465" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:46.466" grpc.time_ms=11.186 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1627gitlab # [ 207.592240] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:46.525Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"85390f393c0accfeebd7a1fd","created_at":"2026-08-11T09:42:45.610Z","trace_propagation_headers":{"sentry-trace":"436e5c49b14f45f6a2b5c1f2d300a03e-15345573ab284485","baggage":"sentry-trace_id=436e5c49b14f45f6a2b5c1f2d300a03e,sentry-release=Unknown"},"correlation_id":"01KZR37XA9M0TKCWTANXKQ5AVP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:45.614Z","job_size_bytes":46,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-85390f393c0accfeebd7a1fd: done: 0.131651 sec","job_status":"done","queue_duration_s":0.779378,"scheduling_latency_s":0.779402,"gitaly_calls":2,"gitaly_duration_s":0.056444,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.012088,"redis_read_bytes":68,"redis_write_bytes":4888,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002073,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000809,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2115,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002312,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.005608,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":754,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001286,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048081,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000364571,"duration_s":0.131651,"completed_at":"2026-08-11T09:42:46.525Z","load_balancing_strategy":"primary","db_duration_s":0.015047,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1628gitlab # [ 207.598104] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:46.528Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"49be79ab1b6f4a14c23bd72c","created_at":"2026-08-11T09:42:45.625Z","trace_propagation_headers":{"sentry-trace":"436e5c49b14f45f6a2b5c1f2d300a03e-15345573ab284485","baggage":"sentry-trace_id=436e5c49b14f45f6a2b5c1f2d300a03e,sentry-release=Unknown"},"correlation_id":"01KZR37XA9M0TKCWTANXKQ5AVP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:45.629Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-49be79ab1b6f4a14c23bd72c: start","job_status":"start","queue_duration_s":0.89909,"scheduling_latency_s":0.899113}1629gitlab # [ 207.734927] gitaly[1381]: time="2026-08-11T09:42:46.686Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP diskcache=47c56470-c168-4469-8608-5e2bfaffeb60 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-11T15:42:46.660" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:46.661" pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1630gitlab # [ 207.753232] gitaly[1381]: time="2026-08-11T09:42:46.686Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1280 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-11T15:42:46.660" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:46.661" grpc.time_ms=25.083 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1631gitlab # [ 207.789745] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:46.740Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"49be79ab1b6f4a14c23bd72c","created_at":"2026-08-11T09:42:45.625Z","trace_propagation_headers":{"sentry-trace":"436e5c49b14f45f6a2b5c1f2d300a03e-15345573ab284485","baggage":"sentry-trace_id=436e5c49b14f45f6a2b5c1f2d300a03e,sentry-release=Unknown"},"correlation_id":"01KZR37XA9M0TKCWTANXKQ5AVP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:45.629Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-49be79ab1b6f4a14c23bd72c: done: 0.212767 sec","job_status":"done","queue_duration_s":0.89909,"scheduling_latency_s":0.899113,"gitaly_calls":1,"gitaly_duration_s":0.028464,"redis_calls":15,"redis_duration_s":0.018879,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000501,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001868,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001178,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.015332,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.014,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.112937,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.175505267,"duration_s":0.212767,"completed_at":"2026-08-11T09:42:46.740Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.126282,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1632gitlab # [ 207.874108] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:46.824Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"026b831fdc8625dece70c9ed","created_at":"2026-08-11T09:42:45.824Z","trace_propagation_headers":{"sentry-trace":"436e5c49b14f45f6a2b5c1f2d300a03e-15345573ab284485","baggage":"sentry-trace_id=436e5c49b14f45f6a2b5c1f2d300a03e,sentry-release=Unknown"},"correlation_id":"01KZR37XA9M0TKCWTANXKQ5AVP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:45.826Z","job_size_bytes":23,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-026b831fdc8625dece70c9ed: start","job_status":"start","queue_duration_s":0.998075,"scheduling_latency_s":0.998151}1633gitlab # [ 207.951507] gitaly[1381]: time="2026-08-11T09:42:46.902Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=650 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-11T09:43:16.890" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:46.891" grpc.time_ms=10.987 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1634gitlab # [ 207.988947] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:46.939Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"026b831fdc8625dece70c9ed","created_at":"2026-08-11T09:42:45.824Z","trace_propagation_headers":{"sentry-trace":"436e5c49b14f45f6a2b5c1f2d300a03e-15345573ab284485","baggage":"sentry-trace_id=436e5c49b14f45f6a2b5c1f2d300a03e,sentry-release=Unknown"},"correlation_id":"01KZR37XA9M0TKCWTANXKQ5AVP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:45.826Z","job_size_bytes":23,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-026b831fdc8625dece70c9ed: done: 0.115256 sec","job_status":"done","queue_duration_s":0.998075,"scheduling_latency_s":0.998151,"gitaly_calls":1,"gitaly_duration_s":0.035853,"redis_calls":16,"redis_duration_s":0.017575999999999998,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000319,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.012929,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.002937,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001391,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.05058,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.115256,"completed_at":"2026-08-11T09:42:46.939Z","load_balancing_strategy":"primary","db_duration_s":0.004009,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1635gitlab # [ 207.991376] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:46.942Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"051ba6b0bc9ac032fe07d394","created_at":"2026-08-11T09:42:46.296Z","trace_propagation_headers":{"sentry-trace":"436e5c49b14f45f6a2b5c1f2d300a03e-15345573ab284485","baggage":"sentry-trace_id=436e5c49b14f45f6a2b5c1f2d300a03e,sentry-release=Unknown"},"correlation_id":"01KZR37XA9M0TKCWTANXKQ5AVP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9336e38ddbaa8341d8348adfda4ee39713d159674231f944fcadcc94b37b6967","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:46.302Z","job_size_bytes":467,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-051ba6b0bc9ac032fe07d394: start","job_status":"start","queue_duration_s":0.640455,"scheduling_latency_s":0.640508}1636gitlab # [ 208.147415] gitaly[1381]: time="2026-08-11T09:42:47.098Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T09:43:17.096" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:47.097" grpc.time_ms=1.232 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1637gitlab # [ 208.188854] gitaly[1381]: time="2026-08-11T09:42:47.140Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-11T09:42:57.113" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T09:42:47.124" grpc.time_ms=15.256 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1638gitlab # [ 208.307872] gitaly[1381]: time="2026-08-11T09:42:47.259Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T09:43:17.256" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:47.257" grpc.time_ms=1.464 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1639gitlab # [ 208.357867] gitaly[1381]: time="2026-08-11T09:42:47.275Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=324 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-11T09:43:17.266" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:47.267" grpc.time_ms=8.471 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1640gitlab # [ 208.389165] nixbot[3159]: {"ts": "2026-08-11T09:42:47.314Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1641gitlab # [ 208.393158] nixbot[3159]: {"ts": "2026-08-11T09:42:47.336Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1642gitlab # [ 208.398123] nixbot[3159]: {"ts": "2026-08-11T09:42:47.349Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1643gitlab # [ 208.402891] nixbot[3159]: {"ts": "2026-08-11T09:42:47.354Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1644gitlab # [ 208.406784] nixbot[3159]: {"ts": "2026-08-11T09:42:47.358Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1645gitlab # [ 208.412302] nixbot[3159]: {"ts": "2026-08-11T09:42:47.363Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1646gitlab # [ 208.417709] gitaly[1381]: time="2026-08-11T09:42:47.369Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T09:42:57.021" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T09:42:47.362" grpc.time_ms=7.056 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1647gitlab # [ 208.418909] nixbot[3159]: {"ts": "2026-08-11T09:42:47.369Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1648gitlab # [ 208.420814] nixbot[3159]: {"ts": "2026-08-11T09:42:47.372Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1649gitlab # [ 208.425787] nixbot[3159]: {"ts": "2026-08-11T09:42:47.377Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1650gitlab # [ 208.427863] nixbot[3159]: {"ts": "2026-08-11T09:42:47.379Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1651gitlab # [ 208.432255] nixbot[3159]: {"ts": "2026-08-11T09:42:47.383Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1652gitlab # [ 208.437325] nixbot[3159]: {"ts": "2026-08-11T09:42:47.388Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1653gitlab # [ 208.440643] nixbot[3159]: {"ts": "2026-08-11T09:42:47.392Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1654gitlab # [ 208.442890] nixbot[3159]: {"ts": "2026-08-11T09:42:47.394Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1655gitlab # [ 208.445915] nixbot[3159]: {"ts": "2026-08-11T09:42:47.397Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1656gitlab # [ 208.448088] nixbot[3159]: {"ts": "2026-08-11T09:42:47.399Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1657gitlab # [ 208.450135] nixbot[3159]: {"ts": "2026-08-11T09:42:47.401Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1658gitlab # [ 208.452096] nixbot[3159]: {"ts": "2026-08-11T09:42:47.403Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1659gitlab # [ 208.456834] nixbot[3159]: {"ts": "2026-08-11T09:42:47.408Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1660gitlab # [ 208.458887] nixbot[3159]: {"ts": "2026-08-11T09:42:47.410Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1661gitlab # [ 208.460987] nixbot[3159]: {"ts": "2026-08-11T09:42:47.412Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1662gitlab # [ 208.464781] nixbot[3159]: {"ts": "2026-08-11T09:42:47.416Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1663gitlab # [ 208.466700] nixbot[3159]: {"ts": "2026-08-11T09:42:47.418Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1664gitlab # [ 208.468987] nixbot[3159]: {"ts": "2026-08-11T09:42:47.420Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1665gitlab # [ 208.470973] nixbot[3159]: {"ts": "2026-08-11T09:42:47.422Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1666gitlab # [ 208.936417] nixbot[3159]: INFO: Started server process [3159]1667gitlab # [ 208.940565] nixbot[3159]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1668gitlab # [ 208.956062] nixbot[3159]: INFO: ::ffff:127.0.0.1:57346 - "GET /health HTTP/1.1" 200 OK1669gitlab # [ 208.969546] systemd[1]: Started nixbot CI service.1670gitlab # [ 208.975810] systemd[1]: Reached target Multi-User System.1671gitlab # [ 208.979456] systemd[1]: Startup finished in 1.611s (kernel) + 4.322s (initrd) + 3min 23.045s (userspace) = 3min 28.979s.1672gitlab # [ 209.051650] gitaly[1381]: time="2026-08-11T09:42:48.002Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=969 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-11T09:43:17.088" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:47.989" grpc.time_ms=13.197 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1673gitlab # [ 209.096603] gitaly[1381]: time="2026-08-11T09:42:48.048Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=37 command.spawn_token_fork_ms=35 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR37XA9M0TKCWTANXKQ5AVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-11T09:43:18.004" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:48.004" grpc.time_ms=43.084 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1674gitlab # [ 209.210254] sidekiq-cluster[2141]: {"severity":"WARN","time":"2026-08-11T09:42:48.160Z","class":"CreatePipelineWorker","correlation_id":"01KZR37XA9M0TKCWTANXKQ5AVP","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"075c9ab1f688abeabd7100784bc099321ae5e1e8","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"075c9ab1f688abeabd7100784bc099321ae5e1e8","ref":"refs/heads/master"},"retry":0}1675gitlab # [ 209.222848] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:48.173Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"051ba6b0bc9ac032fe07d394","created_at":"2026-08-11T09:42:46.296Z","trace_propagation_headers":{"sentry-trace":"436e5c49b14f45f6a2b5c1f2d300a03e-15345573ab284485","baggage":"sentry-trace_id=436e5c49b14f45f6a2b5c1f2d300a03e,sentry-release=Unknown"},"correlation_id":"01KZR37XA9M0TKCWTANXKQ5AVP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9336e38ddbaa8341d8348adfda4ee39713d159674231f944fcadcc94b37b6967","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:46.302Z","job_size_bytes":467,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-051ba6b0bc9ac032fe07d394: done: 1.231331 sec","job_status":"done","queue_duration_s":0.640455,"scheduling_latency_s":0.640508,"gitaly_calls":7,"gitaly_duration_s":0.2791,"redis_calls":53,"redis_duration_s":0.022323,"redis_read_bytes":171,"redis_write_bytes":4426,"redis_cache_calls":4,"redis_cache_duration_s":0.001521,"redis_cache_read_bytes":10,"redis_cache_write_bytes":342,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.011206,"redis_feature_flag_read_bytes":18,"redis_feature_flag_write_bytes":2433,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002506,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.005292,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001798,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":40,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":40,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.123,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.115,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.760645,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001004876,"duration_s":1.231331,"completed_at":"2026-08-11T09:42:48.173Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.154781,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1676gitlab # [ 209.313126] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:48.176Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"200e05c0df2cf782f1484af2","created_at":"2026-08-11T09:42:46.511Z","trace_propagation_headers":{"sentry-trace":"436e5c49b14f45f6a2b5c1f2d300a03e-d80c627dac554630","baggage":"sentry-trace_id=436e5c49b14f45f6a2b5c1f2d300a03e,sentry-release=Unknown"},"correlation_id":"01KZR37XA9M0TKCWTANXKQ5AVP","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:46.515Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-200e05c0df2cf782f1484af2: start","job_status":"start","queue_duration_s":1.660671,"scheduling_latency_s":1.660711}1677gitlab # [ 209.314317] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:48.226Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"200e05c0df2cf782f1484af2","created_at":"2026-08-11T09:42:46.511Z","trace_propagation_headers":{"sentry-trace":"436e5c49b14f45f6a2b5c1f2d300a03e-d80c627dac554630","baggage":"sentry-trace_id=436e5c49b14f45f6a2b5c1f2d300a03e,sentry-release=Unknown"},"correlation_id":"01KZR37XA9M0TKCWTANXKQ5AVP","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:46.515Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-200e05c0df2cf782f1484af2: done: 0.050384 sec","job_status":"done","queue_duration_s":1.660671,"scheduling_latency_s":1.660711,"redis_calls":19,"redis_duration_s":0.006288,"redis_read_bytes":21,"redis_write_bytes":4290,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002566,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000638,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2261,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002205,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000879,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033573,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.008339886999999999,"duration_s":0.050384,"completed_at":"2026-08-11T09:42:48.226Z","load_balancing_strategy":"primary","db_duration_s":0.00731,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1678gitlab # [ 209.352499] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:48.228Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"3783b45a7d44836bf498eb5d","created_at":"2026-08-11T09:42:48.213Z","trace_propagation_headers":{"sentry-trace":"436e5c49b14f45f6a2b5c1f2d300a03e-9cc8d55cced84482","baggage":"sentry-trace_id=436e5c49b14f45f6a2b5c1f2d300a03e,sentry-release=Unknown"},"correlation_id":"01KZR37XA9M0TKCWTANXKQ5AVP","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:48.219Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-3783b45a7d44836bf498eb5d: start","job_status":"start","queue_duration_s":0.009633,"scheduling_latency_s":0.009699}1679gitlab # [ 209.379318] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:48.309Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"3783b45a7d44836bf498eb5d","created_at":"2026-08-11T09:42:48.213Z","trace_propagation_headers":{"sentry-trace":"436e5c49b14f45f6a2b5c1f2d300a03e-9cc8d55cced84482","baggage":"sentry-trace_id=436e5c49b14f45f6a2b5c1f2d300a03e,sentry-release=Unknown"},"correlation_id":"01KZR37XA9M0TKCWTANXKQ5AVP","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:48.219Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-3783b45a7d44836bf498eb5d: done: 0.080415 sec","job_status":"done","queue_duration_s":0.009633,"scheduling_latency_s":0.009699,"redis_calls":11,"redis_duration_s":0.004914,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000561,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003656,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000697,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.054631,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00045313,"duration_s":0.080415,"completed_at":"2026-08-11T09:42:48.309Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018584,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1680gitlab # [ 209.520711] gitaly[1381]: time="2026-08-11T09:42:48.472Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=957 command.oublock=0 command.real_time_ms=116 command.spawn_token_fork_ms=107 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR380B1WZV6NVE5FZ2GZY24 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-11T09:43:18.052" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:48.353" grpc.time_ms=118.98 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1681gitlab: (finished: waiting for unit nixbot.service, in 2.11 seconds)1682gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1683gitlab # [ 209.627965] nixbot[3159]: INFO: ::ffff:127.0.0.1:57362 - "GET /health HTTP/1.1" 200 OK1684gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.03 seconds)1685subtest: project discovered and webhook registered1686gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1687gitlab # [ 209.717114] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:42:48 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.20.0" 621688gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.09 seconds)1689gitlab # [ 209.918800] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:42:48 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4876 "" "python-httpx/0.28.1" 9631690gitlab # [ 209.928711] nixbot[3159]: {"ts": "2026-08-11T09:42:48.871Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1691gitlab # [ 209.950279] nixbot[3159]: {"ts": "2026-08-11T09:42:48.901Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1692gitlab # [ 210.027148] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:42:48 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 641693gitlab # [ 210.030130] nixbot[3159]: {"ts": "2026-08-11T09:42:48.979Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1694gitlab # [ 210.032117] nixbot[3159]: {"ts": "2026-08-11T09:42:48.981Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1695gitlab # [ 210.162912] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:42:49 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 868 "" "python-httpx/0.28.1" 1301696gitlab # [ 210.167230] nixbot[3159]: {"ts": "2026-08-11T09:42:49.115Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1697gitlab # [ 210.459420] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:42:49 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4876 "" "python-httpx/0.28.1" 2851698gitlab # [ 210.464359] nixbot[3159]: {"ts": "2026-08-11T09:42:49.415Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1699gitlab # [ 210.563212] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:42:49 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 831 "" "python-httpx/0.28.1" 771700gitlab # [ 210.572148] nixbot[3159]: {"ts": "2026-08-11T09:42:49.516Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1701gitlab # [ 210.628461] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:42:49 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 868 "" "python-httpx/0.28.1" 561702gitlab # [ 210.638393] nixbot[3159]: {"ts": "2026-08-11T09:42:49.581Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1703gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1704gitlab # [ 210.722720] gitaly[1381]: time="2026-08-11T09:42:49.673Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZR381ZS71DJ0Q9K1RGX044H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-11T09:43:19.353" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T09:42:49.654" grpc.time_ms=18.109 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1705gitlab # [ 210.775496] gitaly[1381]: time="2026-08-11T09:42:49.727Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR381ZS71DJ0Q9K1RGX044H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T09:43:19.425" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:49.725" grpc.time_ms=1.232 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1706gitlab # [ 210.806641] gitaly[1381]: time="2026-08-11T09:42:49.758Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR381ZS71DJ0Q9K1RGX044H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-11T09:42:59.010" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:49.751" grpc.time_ms=6.796 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1707gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.15 seconds)1708(finished: subtest: project discovered and webhook registered, in 1.24 seconds)1709subtest: push delivers the webhook1710gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1711gitlab # [ 210.869841] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:42:49 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 831 "" "curl/8.20.0" 741712gitlab # [ 210.897379] nixbot[3159]: {"ts": "2026-08-11T09:42:49.846Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1713gitlab # [ 210.902671] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:42:49 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 731 "" "python-httpx/0.28.1" 2551714gitlab # [ 210.945101] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:42:49 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.54.0" 271715gitlab # [ 210.969640] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:42:49 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 671716gitlab # [ 210.971050] nixbot[3159]: {"ts": "2026-08-11T09:42:49.922Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1717gitlab # [ 210.978069] nixbot[3159]: {"ts": "2026-08-11T09:42:49.928Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1718gitlab # [ 211.033080] gitaly[1381]: time="2026-08-11T09:42:49.982Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR3829A18D2DXH41XDJFKAX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T09:42:49.965" grpc.time_ms=16.909 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1719gitlab # [ 211.034304] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:42:49 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 203 "" "git/2.54.0" 851720gitlab # Enumerating objects: 5, done.1721gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1722gitlab # Delta compression using up to 4 threads1723gitlab # [ 211.074321] gitaly[1381]: time="2026-08-11T09:42:50.025Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR382BHHEBXW29VB49N51C5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=194 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T09:42:50.015" grpc.time_ms=10.333 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc1724gitlab # [ 211.076084] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:42:50 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 571725gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1726gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 136.00 KiB/s, done.1727gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1728gitlab # [ 211.196871] gitaly[1381]: time="2026-08-11T09:42:50.148Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR382DEEBFDHEP504MJQYEQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T09:42:50.133" pid=1381 remote_ip="2001:db8:1::1" request_sha=083c43590fffa527704b32b8836424e8ed055017 response_bytes=149 span.kind=server system=grpc1729gitlab # [ 211.198177] gitaly[1381]: time="2026-08-11T09:42:50.148Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR382DEEBFDHEP504MJQYEQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T09:42:50.133" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc1730gitlab # [ 211.202444] gitlab-workhorse[1283]: time="2026-08-11T09:42:50Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1491731gitlab # [ 211.203349] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:42:50 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 149 "" "git/2.54.0" 1191732gitlab # [ 211.204221] gitaly[1381]: time="2026-08-11T09:42:50.148Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR382DEEBFDHEP504MJQYEQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T09:42:50.133" grpc.time_ms=14.992 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc1733gitlab # [ 211.409083] gitaly[1381]: time="2026-08-11T09:42:50.360Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR382HA4N8ZSTFE4W036ASR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T09:42:50.316" pid=1381 remote_ip="2001:db8:1::1" request_sha=cded3a2855a0b651486aabe90b00baa0905da8f8 response_bytes=228 span.kind=server system=grpc1734gitlab # [ 211.410376] gitaly[1381]: time="2026-08-11T09:42:50.360Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1203 command.oublock=0 command.real_time_ms=38 command.spawn_token_fork_ms=4 command.system_time_ms=6 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01KZR382HA4N8ZSTFE4W036ASR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T09:42:50.316" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=2 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc1735gitlab # [ 211.414481] gitaly[1381]: time="2026-08-11T09:42:50.362Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1203 command.oublock=0 command.real_time_ms=38 command.spawn_token_fork_ms=4 command.system_time_ms=6 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01KZR382HA4N8ZSTFE4W036ASR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T09:42:50.316" grpc.time_ms=45.576 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=2 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc1736gitlab # [ 211.415422] gitlab-workhorse[1283]: time="2026-08-11T09:42:50Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2281737gitlab # [ 211.415655] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:42:50 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 228 "" "git/2.54.0" 2081738gitlab # [ 211.530375] gitaly[1381]: time="2026-08-11T09:42:50.481Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=5 command.system_time_ms=1 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01KZR382DNDWAJN3C2GFH7AN01 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-11T09:43:00.001" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=253 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:50.461" grpc.time_ms=17.32 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1739gitlab # [ 211.599047] gitaly[1381]: time="2026-08-11T09:42:50.550Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=333 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=8 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR382DNDWAJN3C2GFH7AN01 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-11T09:43:20.235" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-11T09:42:50.535" grpc.time_ms=14.232 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1740gitlab # [ 211.631902] gitaly[1381]: time="2026-08-11T09:42:50.582Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=37 command.spawn_token_fork_ms=7 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR382TXH4E54DNENCAHWGKM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T09:42:50.543" grpc.time_ms=38.975 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc1741gitlab # [ 211.633097] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:42:50 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 1221742gitlab # [ 211.662053] gitaly[1381]: time="2026-08-11T09:42:50.613Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KZR382DNDWAJN3C2GFH7AN01 duration_ms=290ns method=POST pid=1381 status=200 url="http://unix/api/v4/internal/allowed"1743gitlab # [ 211.706442] gitaly[1381]: time="2026-08-11T09:42:50.657Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KZR382DNDWAJN3C2GFH7AN01 duration_ms=43ns method=POST pid=1381 status=200 url="http://unix/api/v4/internal/pre_receive"1744gitlab # [ 211.707878] gitaly[1381]: time="2026-08-11T09:42:50.658Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR382DNDWAJN3C2GFH7AN01 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5316 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T09:42:50.322" grpc.time_ms=335.269 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1745gitlab # [ 211.776363] gitaly[1381]: time="2026-08-11T09:42:50.726Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR382ZG0DZS14FY598E8XXN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T09:42:50.704" pid=1381 remote_ip="2001:db8:1::1" request_sha=cc69fbe136984084848b4359b2caac0b76309173 response_bytes=67 span.kind=server system=grpc1746gitlab # [ 211.777599] gitaly[1381]: time="2026-08-11T09:42:50.727Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=4 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR382ZG0DZS14FY598E8XXN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T09:42:50.704" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc1747gitlab # [ 211.781108] gitaly[1381]: time="2026-08-11T09:42:50.731Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=4 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR382ZG0DZS14FY598E8XXN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T09:42:50.704" grpc.time_ms=23.835 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc1748gitlab # [ 211.782163] gitlab-workhorse[1283]: time="2026-08-11T09:42:50Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671749gitlab # [ 211.782941] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:42:50 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.54.0" 1201750gitlab # [ 211.789517] gitaly[1381]: time="2026-08-11T09:42:50.740Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR382DNDWAJN3C2GFH7AN01 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T09:42:50.740" grpc.time_ms=0.563 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1751gitlab # [ 211.899890] gitaly[1381]: time="2026-08-11T09:42:50.851Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR382DNDWAJN3C2GFH7AN01 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T09:42:50.845" grpc.time_ms=5.65 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1752gitlab # [ 211.949209] gitaly[1381]: time="2026-08-11T09:42:50.899Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=4 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR3836X6W6GG1V9Q842YTHG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T09:42:50.886" grpc.time_ms=12.638 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc1753gitlab # [ 211.956253] gitaly[1381]: time="2026-08-11T09:42:50.907Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR382DNDWAJN3C2GFH7AN01 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T09:42:50.907" grpc.time_ms=0.393 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1754gitlab # [ 211.991763] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:42:50 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 951755gitlab # [ 212.065313] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:51.014Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","075c9ab1f688abeabd7100784bc099321ae5e1e8 f40b211475671ebb570f445080aee2bc707d4975 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"b5267eb9d66aad1963c833f9","created_at":"2026-08-11T09:42:51.004Z","trace_propagation_headers":{"sentry-trace":"d5045f6072754a9b958e60f3677f96e4-45f976e14ff8406a","baggage":"sentry-trace_id=d5045f6072754a9b958e60f3677f96e4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR382DNDWAJN3C2GFH7AN01","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:51.006Z","job_size_bytes":185,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-b5267eb9d66aad1963c833f9: start","job_status":"start","queue_duration_s":0.008375,"scheduling_latency_s":0.008414}1756gitlab # [ 212.120361] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:51.070Z","message":"changes: \"075c9ab1f688abeabd7100784bc099321ae5e1e8 f40b211475671ebb570f445080aee2bc707d4975 refs/heads/master\\n\""}1757gitlab # [ 212.121794] gitaly[1381]: time="2026-08-11T09:42:51.071Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KZR382DNDWAJN3C2GFH7AN01 duration_ms=97ns method=POST pid=1381 status=200 url="http://unix/api/v4/internal/post_receive"1758gitlab # [ 212.126257] gitaly[1381]: time="2026-08-11T09:42:51.071Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR382DNDWAJN3C2GFH7AN01 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4810 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T09:42:50.973" grpc.time_ms=98.5 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1759gitlab # [ 212.160177] gitaly[1381]: time="2026-08-11T09:42:51.111Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR383A22A2NV3GBR963XYF2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T09:42:51.063" pid=1381 remote_ip="2001:db8:1::1" request_sha=69dcef142412daaffeeda28f6446e517599d516e response_bytes=214 span.kind=server system=grpc1760gitlab # [ 212.161459] gitaly[1381]: time="2026-08-11T09:42:51.111Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1168 command.oublock=0 command.real_time_ms=44 command.spawn_token_fork_ms=4 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR383A22A2NV3GBR963XYF2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T09:42:51.063" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc1761gitlab # [ 212.195544] gitlab-workhorse[1283]: time="2026-08-11T09:42:51Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2141762gitlab # [ 212.196730] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:42:51 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 214 "" "git/2.54.0" 1991763gitlab # [ 212.205848] gitaly[1381]: time="2026-08-11T09:42:51.156Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1168 command.oublock=0 command.real_time_ms=44 command.spawn_token_fork_ms=4 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR383A22A2NV3GBR963XYF2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T09:42:51.063" grpc.time_ms=48.335 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc1764gitlab # [ 212.207065] gitaly[1381]: time="2026-08-11T09:42:51.157Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KZR382DNDWAJN3C2GFH7AN01 diskcache=41362478-4b4d-44b8-bf0a-0a94b1002f1f grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T09:42:50.241" pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1765gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 1.40 seconds)1766gitlab: must succeed: git -C /tmp/test-flake rev-parse master1767gitlab # [ 212.247849] gitaly[1381]: time="2026-08-11T09:42:51.198Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=227 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=892928 command.minflt=13085 command.oublock=32 command.real_time_ms=861 command.spawn_token_fork_ms=4 command.system_time_ms=175 command.user_time_ms=52 component=gitaly.StreamServerInterceptor correlation_id=01KZR382DNDWAJN3C2GFH7AN01 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T09:42:50.241" grpc.time_ms=956.379 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1768gitlab # To http://gitlab/root/test-flake.git1769gitlab # 075c9ab..f40b211 master -> master1770gitlab # [ 212.249072] gitlab-workhorse[1283]: time="2026-08-11T09:42:51Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521771gitlab # [ 212.254989] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:42:51 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.54.0" 11601772gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1773gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f40b211475671ebb570f445080aee2bc707d4975'1774gitlab # [ 212.278802] gitaly[1381]: time="2026-08-11T09:42:51.230Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=71 command.spawn_token_fork_ms=45 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR382DNDWAJN3C2GFH7AN01 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T09:43:01.146" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T09:42:51.157" grpc.time_ms=72.975 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1775gitlab # [ 212.313465] nixbot[3159]: INFO: ::ffff:127.0.0.1:57376 - "GET /api/repos/gitlab/root/test-flake/builds?commit=f40b211475671ebb570f445080aee2bc707d4975 HTTP/1.1" 200 OK1776gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f40b211475671ebb570f445080aee2bc707d4975', in 0.04 seconds)1777gitlab # [ 212.318540] gitaly[1381]: time="2026-08-11T09:42:51.270Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR382DNDWAJN3C2GFH7AN01 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-11T09:43:01.248" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T09:42:51.260" grpc.time_ms=9.77 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1778gitlab # [ 212.352084] gitaly[1381]: time="2026-08-11T09:42:51.303Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR383KPFT8VE9H5HD6KRQK3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T09:43:21.001" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:51.302" grpc.time_ms=0.745 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1779gitlab # [ 212.380043] gitaly[1381]: time="2026-08-11T09:42:51.331Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR382DNDWAJN3C2GFH7AN01 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-11T09:43:01.013" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T09:42:51.324" grpc.time_ms=7.192 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1780gitlab # [ 212.413869] gitaly[1381]: time="2026-08-11T09:42:51.365Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=648 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR383KPFT8VE9H5HD6KRQK3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-11T09:43:21.056" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T09:42:51.357" grpc.time_ms=7.787 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1781gitlab # [ 212.423940] gitaly[1381]: time="2026-08-11T09:42:51.375Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=653 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR382DNDWAJN3C2GFH7AN01 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-11T09:43:21.362" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:51.362" grpc.time_ms=12.209 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1782gitlab # [ 212.442698] gitaly[1381]: time="2026-08-11T09:42:51.394Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=346 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR382DNDWAJN3C2GFH7AN01 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-11T09:43:01.049" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-11T09:42:51.390" grpc.time_ms=4.081 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1783gitlab # [ 212.462873] gitaly[1381]: time="2026-08-11T09:42:51.414Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR382DNDWAJN3C2GFH7AN01 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T09:43:01.067" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T09:42:51.407" grpc.time_ms=6.353 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1784gitlab # [ 212.517540] gitaly[1381]: time="2026-08-11T09:42:51.469Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR383KPFT8VE9H5HD6KRQK3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T09:43:01.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T09:42:51.462" grpc.time_ms=6.478 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1785gitlab # [ 212.572634] gitaly[1381]: time="2026-08-11T09:42:51.524Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR383KPFT8VE9H5HD6KRQK3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-11T09:43:01.063" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T09:42:51.523" grpc.time_ms=0.324 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1786gitlab # [ 212.587955] gitaly[1381]: time="2026-08-11T09:42:51.539Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZR383KPFT8VE9H5HD6KRQK3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-11T09:43:01.071" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T09:42:51.532" grpc.time_ms=7.251 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1787gitlab # [ 212.629254] gitaly[1381]: time="2026-08-11T09:42:51.580Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR383KPFT8VE9H5HD6KRQK3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T09:42:51.580" grpc.time_ms=0.469 pid=1381 span.kind=server system=grpc1788gitlab # [ 212.668387] gitaly[1381]: time="2026-08-11T09:42:51.619Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR383KPFT8VE9H5HD6KRQK3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4157 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T09:42:51.619" grpc.time_ms=0.446 pid=1381 span.kind=server system=grpc1789gitlab # [ 212.694558] gitaly[1381]: time="2026-08-11T09:42:51.646Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR383KPFT8VE9H5HD6KRQK3 diskcache=cdf53b5c-8a37-4d12-af9d-cd4b1fb2c7fb grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-11T09:43:01.082" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T09:42:51.542" pid=1381 ref=refs/keep-around/075c9ab1f688abeabd7100784bc099321ae5e1e8 remote_ip="2001:db8:1::1" revision=075c9ab1f688abeabd7100784bc099321ae5e1e8 span.kind=server system=grpc username=root1790gitlab # [ 212.712796] gitaly[1381]: time="2026-08-11T09:42:51.646Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=59 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5166 command.oublock=8 command.real_time_ms=93 command.spawn_token_fork_ms=1 command.system_time_ms=31 command.user_time_ms=28 component=gitaly.UnaryServerInterceptor correlation_id=01KZR383KPFT8VE9H5HD6KRQK3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-11T09:43:01.082" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T09:42:51.542" grpc.time_ms=103.524 pid=1381 ref=refs/keep-around/075c9ab1f688abeabd7100784bc099321ae5e1e8 remote_ip="2001:db8:1::1" revision=075c9ab1f688abeabd7100784bc099321ae5e1e8 span.kind=server system=grpc username=root1791gitlab # [ 212.713964] gitaly[1381]: time="2026-08-11T09:42:51.651Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR383KPFT8VE9H5HD6KRQK3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T09:43:21.349" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:51.650" grpc.time_ms=0.474 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1792gitlab # [ 212.881266] gitaly[1381]: time="2026-08-11T09:42:51.832Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR382DNDWAJN3C2GFH7AN01 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-11T09:43:01.007" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:51.828" grpc.time_ms=4.063 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1793gitlab # [ 212.946423] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:42:51 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/075c9ab1f688abeabd7100784bc099321ae5e1e8 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 6421794gitlab # [ 212.947983] nixbot[3159]: {"ts": "2026-08-11T09:42:51.898Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/075c9ab1f688abeabd7100784bc099321ae5e1e8 \"HTTP/1.1 201 Created\""}1795gitlab # [ 212.955757] nixbot[3159]: {"ts": "2026-08-11T09:42:51.907Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-075c9ab1f688-0"}1796gitlab # [ 212.971750] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:51.922Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","075c9ab1f688abeabd7100784bc099321ae5e1e8 f40b211475671ebb570f445080aee2bc707d4975 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"b5267eb9d66aad1963c833f9","created_at":"2026-08-11T09:42:51.004Z","trace_propagation_headers":{"sentry-trace":"d5045f6072754a9b958e60f3677f96e4-45f976e14ff8406a","baggage":"sentry-trace_id=d5045f6072754a9b958e60f3677f96e4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR382DNDWAJN3C2GFH7AN01","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-11T09:42:51.006Z","job_size_bytes":185,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-b5267eb9d66aad1963c833f9: done: 0.908156 sec","job_status":"done","queue_duration_s":0.008375,"scheduling_latency_s":0.008414,"gitaly_calls":7,"gitaly_duration_s":0.222658,"redis_calls":112,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.152326,"redis_read_bytes":350,"redis_write_bytes":13069,"redis_cache_calls":9,"redis_cache_duration_s":0.041743,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003632,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":323,"redis_queues_calls":8,"redis_queues_duration_s":0.008504,"redis_queues_read_bytes":8,"redis_queues_write_bytes":6769,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.009476,"redis_queues_metadata_read_bytes":11,"redis_queues_metadata_write_bytes":1182,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.063067,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.025904,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":29,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":29,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.118,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":29,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.066,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.066,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.118,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.31131,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000624939,"exclusive_lock_hold_duration_s":0.144936018,"duration_s":0.908156,"completed_at":"2026-08-11T09:42:51.922Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.130923,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1797gitlab # [ 212.983599] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:51.933Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"589af79a865852d6c127eab0","created_at":"2026-08-11T09:42:51.283Z","trace_propagation_headers":{"sentry-trace":"d5045f6072754a9b958e60f3677f96e4-aab3301411334e19","baggage":"sentry-trace_id=d5045f6072754a9b958e60f3677f96e4,sentry-release=Unknown"},"correlation_id":"01KZR382DNDWAJN3C2GFH7AN01","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:51.289Z","job_size_bytes":46,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-589af79a865852d6c127eab0: start","job_status":"start","queue_duration_s":0.644229,"scheduling_latency_s":0.644273}1798gitlab # [ 213.007674] systemd[1]: Started Nix Daemon.1799gitlab # [ 213.058987] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:52.009Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"589af79a865852d6c127eab0","created_at":"2026-08-11T09:42:51.283Z","trace_propagation_headers":{"sentry-trace":"d5045f6072754a9b958e60f3677f96e4-aab3301411334e19","baggage":"sentry-trace_id=d5045f6072754a9b958e60f3677f96e4,sentry-release=Unknown"},"correlation_id":"01KZR382DNDWAJN3C2GFH7AN01","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:51.289Z","job_size_bytes":46,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-589af79a865852d6c127eab0: done: 0.075885 sec","job_status":"done","queue_duration_s":0.644229,"scheduling_latency_s":0.644273,"redis_calls":9,"redis_duration_s":0.006116,"redis_read_bytes":23,"redis_write_bytes":782,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002368,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.001145,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.002603,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":304,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017573,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.075885,"completed_at":"2026-08-11T09:42:52.009Z","load_balancing_strategy":"primary","db_duration_s":0.025922,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1800gitlab # [ 213.076944] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:52.015Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"b353e239868d6eae94dcdeba","created_at":"2026-08-11T09:42:51.299Z","trace_propagation_headers":{"sentry-trace":"d5045f6072754a9b958e60f3677f96e4-aab3301411334e19","baggage":"sentry-trace_id=d5045f6072754a9b958e60f3677f96e4,sentry-release=Unknown"},"correlation_id":"01KZR382DNDWAJN3C2GFH7AN01","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:51.302Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-b353e239868d6eae94dcdeba: start","job_status":"start","queue_duration_s":0.712927,"scheduling_latency_s":0.712964}1801gitlab # [ 213.131254] gitaly[1381]: time="2026-08-11T09:42:52.082Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR382DNDWAJN3C2GFH7AN01 diskcache=caed4121-a64b-4c92-992d-dd2ba1173e78 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-11T15:42:52.048" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:52.049" pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1802gitlab # [ 213.132449] gitaly[1381]: time="2026-08-11T09:42:52.083Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=5 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1648 command.oublock=0 command.real_time_ms=31 command.spawn_token_fork_ms=3 command.system_time_ms=7 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01KZR382DNDWAJN3C2GFH7AN01 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-11T15:42:52.048" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:52.049" grpc.time_ms=33.478 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1803gitlab # [ 213.152984] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:52.104Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"b353e239868d6eae94dcdeba","created_at":"2026-08-11T09:42:51.299Z","trace_propagation_headers":{"sentry-trace":"d5045f6072754a9b958e60f3677f96e4-aab3301411334e19","baggage":"sentry-trace_id=d5045f6072754a9b958e60f3677f96e4,sentry-release=Unknown"},"correlation_id":"01KZR382DNDWAJN3C2GFH7AN01","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:51.302Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-b353e239868d6eae94dcdeba: done: 0.088803 sec","job_status":"done","queue_duration_s":0.712927,"scheduling_latency_s":0.712964,"gitaly_calls":1,"gitaly_duration_s":0.037331,"redis_calls":12,"redis_duration_s":0.010936999999999999,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003728,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00359,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003619,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.008,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.008,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024976,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.059709265,"duration_s":0.088803,"completed_at":"2026-08-11T09:42:52.104Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016801,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1804gitlab # [ 213.220290] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:52.105Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"5d7ae761c70b1562c945b2a6","created_at":"2026-08-11T09:42:51.572Z","trace_propagation_headers":{"sentry-trace":"d5045f6072754a9b958e60f3677f96e4-aab3301411334e19","baggage":"sentry-trace_id=d5045f6072754a9b958e60f3677f96e4,sentry-release=Unknown"},"correlation_id":"01KZR382DNDWAJN3C2GFH7AN01","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2401d5e2153de811bcdf6182563a5b529feb056bd36790de3acc7dcc185940e7","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:51.578Z","job_size_bytes":467,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-5d7ae761c70b1562c945b2a6: start","job_status":"start","queue_duration_s":0.527562,"scheduling_latency_s":0.527585}1805gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f40b211475671ebb570f445080aee2bc707d4975'1806gitlab # [ 213.240138] gitaly[1381]: time="2026-08-11T09:42:52.127Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR382DNDWAJN3C2GFH7AN01 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T09:43:22.126" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:52.126" grpc.time_ms=0.625 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1807gitlab # [ 213.293471] nix-daemon[3434]: accepted connection from pid 3428, user nixbot1808gitlab # [ 213.336117] gitaly[1381]: time="2026-08-11T09:42:52.284Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=152 command.spawn_token_fork_ms=148 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR382DNDWAJN3C2GFH7AN01 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-11T09:43:02.010" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T09:42:52.131" grpc.time_ms=153.349 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1809gitlab # [ 213.348846] nixbot[3159]: INFO: ::ffff:127.0.0.1:38884 - "GET /api/repos/gitlab/root/test-flake/builds?commit=f40b211475671ebb570f445080aee2bc707d4975 HTTP/1.1" 200 OK1810gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f40b211475671ebb570f445080aee2bc707d4975', in 0.04 seconds)1811gitlab # [ 213.362143] nix-daemon[3434]: accepted connection from pid 3448, user nixbot1812gitlab # [ 213.375156] gitaly[1381]: time="2026-08-11T09:42:52.326Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR382DNDWAJN3C2GFH7AN01 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T09:43:22.024" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:52.325" grpc.time_ms=1.253 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1813gitlab # [ 213.376288] nixbot[3159]: {"ts": "2026-08-11T09:42:52.326Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-075c9ab1f688-0", "argv0": "bwrap"}1814gitlab # [ 213.386475] gitaly[1381]: time="2026-08-11T09:42:52.338Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=325 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR382DNDWAJN3C2GFH7AN01 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-11T09:43:22.033" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:52.334" grpc.time_ms=3.935 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1815gitlab # [ 213.437116] gitaly[1381]: time="2026-08-11T09:42:52.388Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR382DNDWAJN3C2GFH7AN01 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T09:43:02.070" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T09:42:52.381" grpc.time_ms=7.403 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1816gitlab # [ 213.515445] nix-daemon[3434]: accepted connection from pid 3471, user nixbot1817gitlab # [ 213.599257] nix-daemon[3434]: accepted connection from pid 3472, user nixbot1818gitlab # [ 213.850452] gitaly[1381]: time="2026-08-11T09:42:52.801Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=966 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR382DNDWAJN3C2GFH7AN01 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-11T09:43:22.481" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:52.781" grpc.time_ms=19.487 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1819gitlab # [ 213.873336] gitaly[1381]: time="2026-08-11T09:42:52.824Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KZR382DNDWAJN3C2GFH7AN01 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-11T09:43:22.504" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:52.804" grpc.time_ms=19.747 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1820gitlab # [ 213.940244] sidekiq-cluster[2141]: {"severity":"WARN","time":"2026-08-11T09:42:52.891Z","class":"CreatePipelineWorker","correlation_id":"01KZR382DNDWAJN3C2GFH7AN01","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"075c9ab1f688abeabd7100784bc099321ae5e1e8","after":"f40b211475671ebb570f445080aee2bc707d4975","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"f40b211475671ebb570f445080aee2bc707d4975","ref":"refs/heads/master"},"retry":0}1821gitlab # [ 213.947105] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:52.898Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"5d7ae761c70b1562c945b2a6","created_at":"2026-08-11T09:42:51.572Z","trace_propagation_headers":{"sentry-trace":"d5045f6072754a9b958e60f3677f96e4-aab3301411334e19","baggage":"sentry-trace_id=d5045f6072754a9b958e60f3677f96e4,sentry-release=Unknown"},"correlation_id":"01KZR382DNDWAJN3C2GFH7AN01","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2401d5e2153de811bcdf6182563a5b529feb056bd36790de3acc7dcc185940e7","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:51.578Z","job_size_bytes":467,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-5d7ae761c70b1562c945b2a6: done: 0.792255 sec","job_status":"done","queue_duration_s":0.527562,"scheduling_latency_s":0.527585,"gitaly_calls":7,"gitaly_duration_s":0.280715,"redis_calls":33,"redis_duration_s":0.00681,"redis_read_bytes":185,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000928,"redis_cache_read_bytes":44,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001653,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002595,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001634,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":30,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.036,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":26,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.031,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.461345,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.792255,"completed_at":"2026-08-11T09:42:52.898Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.035422,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1822gitlab # [ 213.957764] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:52.900Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"827b5e7c6cdbf9444915d62f","created_at":"2026-08-11T09:42:51.656Z","trace_propagation_headers":{"sentry-trace":"30d80c8e4d434c7c9229c0954daeac6b-50fa99bacbee4509","baggage":"sentry-trace_id=30d80c8e4d434c7c9229c0954daeac6b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR383KPFT8VE9H5HD6KRQK3","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:51.663Z","job_size_bytes":65,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-827b5e7c6cdbf9444915d62f: start","job_status":"start","queue_duration_s":1.236998,"scheduling_latency_s":1.237025}1823gitlab # [ 214.012917] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:52.964Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"827b5e7c6cdbf9444915d62f","created_at":"2026-08-11T09:42:51.656Z","trace_propagation_headers":{"sentry-trace":"30d80c8e4d434c7c9229c0954daeac6b-50fa99bacbee4509","baggage":"sentry-trace_id=30d80c8e4d434c7c9229c0954daeac6b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR383KPFT8VE9H5HD6KRQK3","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:51.663Z","job_size_bytes":65,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-827b5e7c6cdbf9444915d62f: done: 0.063784 sec","job_status":"done","queue_duration_s":1.236998,"scheduling_latency_s":1.237025,"redis_calls":18,"redis_duration_s":0.012620999999999999,"redis_read_bytes":271,"redis_write_bytes":2103,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.008105,"redis_feature_flag_read_bytes":264,"redis_feature_flag_write_bytes":1285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003606,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00091,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029323,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000668521,"duration_s":0.063784,"completed_at":"2026-08-11T09:42:52.964Z","load_balancing_strategy":"primary","db_duration_s":0.018613,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1824gitlab # [ 214.055201] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:52.967Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"4090842223b2f7b329e2d443","created_at":"2026-08-11T09:42:51.708Z","trace_propagation_headers":{"sentry-trace":"30d80c8e4d434c7c9229c0954daeac6b-50fa99bacbee4509","baggage":"sentry-trace_id=30d80c8e4d434c7c9229c0954daeac6b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR383KPFT8VE9H5HD6KRQK3","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:51.717Z","job_size_bytes":65,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-4090842223b2f7b329e2d443: start","job_status":"start","queue_duration_s":1.250324,"scheduling_latency_s":1.250403}1825gitlab # [ 214.099142] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:53.049Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"4090842223b2f7b329e2d443","created_at":"2026-08-11T09:42:51.708Z","trace_propagation_headers":{"sentry-trace":"30d80c8e4d434c7c9229c0954daeac6b-50fa99bacbee4509","baggage":"sentry-trace_id=30d80c8e4d434c7c9229c0954daeac6b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR383KPFT8VE9H5HD6KRQK3","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:51.717Z","job_size_bytes":65,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-4090842223b2f7b329e2d443: done: 0.082609 sec","job_status":"done","queue_duration_s":1.250324,"scheduling_latency_s":1.250403,"redis_calls":15,"redis_duration_s":0.004427,"redis_read_bytes":142,"redis_write_bytes":1431,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001002,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":431,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001816,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001609,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.05444,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000409549,"duration_s":0.082609,"completed_at":"2026-08-11T09:42:53.049Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012739,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1826gitlab # [ 214.155447] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:53.051Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"54c14fd8-8e2d-4516-8403-a45aa09869f3\"}"],"class":"WebHookWorker","jid":"3fd9690ac8eb33c66c237f42","created_at":"2026-08-11T09:42:51.790Z","trace_propagation_headers":{"sentry-trace":"d5045f6072754a9b958e60f3677f96e4-aab3301411334e19","baggage":"sentry-trace_id=d5045f6072754a9b958e60f3677f96e4,sentry-release=Unknown"},"correlation_id":"01KZR382DNDWAJN3C2GFH7AN01","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1bb9b50502bf35104611809310f1bb817c59f54ddf4b834e268119a6e737cecb","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:51.803Z","job_size_bytes":1749,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-3fd9690ac8eb33c66c237f42: start","job_status":"start","queue_duration_s":1.24806,"scheduling_latency_s":1.248082}1827gitlab # [ 214.298225] nixbot[3159]: INFO: ::ffff:127.0.0.1:38900 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted1828gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f40b211475671ebb570f445080aee2bc707d4975'1829gitlab # [ 214.315313] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:53.266Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"54c14fd8-8e2d-4516-8403-a45aa09869f3\"}"],"class":"WebHookWorker","jid":"3fd9690ac8eb33c66c237f42","created_at":"2026-08-11T09:42:51.790Z","trace_propagation_headers":{"sentry-trace":"d5045f6072754a9b958e60f3677f96e4-aab3301411334e19","baggage":"sentry-trace_id=d5045f6072754a9b958e60f3677f96e4,sentry-release=Unknown"},"correlation_id":"01KZR382DNDWAJN3C2GFH7AN01","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1bb9b50502bf35104611809310f1bb817c59f54ddf4b834e268119a6e737cecb","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:51.803Z","job_size_bytes":1749,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-3fd9690ac8eb33c66c237f42: done: 0.214769 sec","job_status":"done","queue_duration_s":1.24806,"scheduling_latency_s":1.248082,"redis_calls":19,"redis_duration_s":0.005581,"redis_read_bytes":31,"redis_write_bytes":5282,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001304,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000545,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3644,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002727,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001005,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.010810313000007454,"cpu_s":0.05881,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000536101,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","duration_s":0.214769,"completed_at":"2026-08-11T09:42:53.266Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002545,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1830gitlab # [ 214.394495] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:53.345Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"55afecb93f2e78dbd4ecb861","created_at":"2026-08-11T09:42:51.832Z","trace_propagation_headers":{"sentry-trace":"30d80c8e4d434c7c9229c0954daeac6b-50fa99bacbee4509","baggage":"sentry-trace_id=30d80c8e4d434c7c9229c0954daeac6b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR383KPFT8VE9H5HD6KRQK3","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:51.876Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-55afecb93f2e78dbd4ecb861: start","job_status":"start","queue_duration_s":1.468998,"scheduling_latency_s":1.469046}1831gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f40b211475671ebb570f445080aee2bc707d4975', in 0.07 seconds)1832gitlab # [ 214.428285] gitaly[1381]: time="2026-08-11T09:42:53.379Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=11 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR385KFMR5E8SFWF7QZCEMD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T09:42:53.359" grpc.time_ms=19.811 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc1833gitlab # [ 214.431477] nixbot[3159]: INFO: ::ffff:127.0.0.1:38910 - "GET /api/repos/gitlab/root/test-flake/builds?commit=f40b211475671ebb570f445080aee2bc707d4975 HTTP/1.1" 200 OK1834gitlab # [ 214.453781] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:42:53 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 1091835gitlab # [ 214.506389] gitaly[1381]: time="2026-08-11T09:42:53.457Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR383KPFT8VE9H5HD6KRQK3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T09:43:23.156" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:53.457" grpc.time_ms=0.704 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1836gitlab # [ 214.535914] gitaly[1381]: time="2026-08-11T09:42:53.487Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR385Q3S2D8DBZMCT85TW81 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T09:42:53.479" pid=1381 remote_ip="2001:db8:1::1" request_sha=cc69fbe136984084848b4359b2caac0b76309173 response_bytes=67 span.kind=server system=grpc1837gitlab # [ 214.537112] gitaly[1381]: time="2026-08-11T09:42:53.487Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR385Q3S2D8DBZMCT85TW81 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T09:42:53.479" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc1838gitlab # [ 214.542353] gitaly[1381]: time="2026-08-11T09:42:53.493Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR383KPFT8VE9H5HD6KRQK3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T09:43:23.192" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:53.492" grpc.time_ms=0.707 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1839gitlab # [ 214.544045] gitaly[1381]: time="2026-08-11T09:42:53.494Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR385Q3S2D8DBZMCT85TW81 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T09:42:53.479" grpc.time_ms=14.853 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc1840gitlab # [ 214.549605] gitlab-workhorse[1283]: time="2026-08-11T09:42:53Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671841gitlab # [ 214.551722] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:42:53 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.54.0" 901842gitlab # [ 214.577809] gitaly[1381]: time="2026-08-11T09:42:53.529Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR383KPFT8VE9H5HD6KRQK3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T09:43:23.226" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:53.526" grpc.time_ms=1.936 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1843gitlab # [ 214.591879] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:53.542Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"55afecb93f2e78dbd4ecb861","created_at":"2026-08-11T09:42:51.832Z","trace_propagation_headers":{"sentry-trace":"30d80c8e4d434c7c9229c0954daeac6b-50fa99bacbee4509","baggage":"sentry-trace_id=30d80c8e4d434c7c9229c0954daeac6b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR383KPFT8VE9H5HD6KRQK3","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:51.876Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-55afecb93f2e78dbd4ecb861: done: 0.197128 sec","job_status":"done","queue_duration_s":1.468998,"scheduling_latency_s":1.469046,"gitaly_calls":3,"gitaly_duration_s":0.016037,"redis_calls":48,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.016233,"redis_read_bytes":208,"redis_write_bytes":6802,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001567,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":16,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.001623,"redis_cache_read_bytes":32,"redis_cache_write_bytes":1470,"redis_feature_flag_calls":7,"redis_feature_flag_duration_s":0.00303,"redis_feature_flag_read_bytes":134,"redis_feature_flag_write_bytes":992,"redis_queues_calls":2,"redis_queues_duration_s":0.000372,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.002559,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":840,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000548,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":165,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.000283,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004684,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":34,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":34,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":22,"db_ci_count":12,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.016,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.11116,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.15409053399999997,"duration_s":0.197128,"completed_at":"2026-08-11T09:42:53.542Z","load_balancing_strategy":"primary","db_duration_s":0.045288,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1844gitlab # [ 214.684386] gitaly[1381]: time="2026-08-11T09:42:53.592Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR385T1SMEHH6CJWGKR3RQ4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T09:42:53.573" pid=1381 remote_ip="2001:db8:1::1" request_sha=fd6971c4ed45ff8c34a166641907190cfd62ef16 response_bytes=342 span.kind=server system=grpc1845gitlab # [ 214.686100] gitlab-workhorse[1283]: time="2026-08-11T09:42:53Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3421846gitlab # [ 214.687824] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:42:53 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 342 "" "git/2.54.0" 881847gitlab # [ 214.688769] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:53.544Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","3fd9690ac8eb33c66c237f42"],"class":"WebHooks::LogExecutionWorker","jid":"5cbb5842a5efac5e2ee5058a","created_at":"2026-08-11T09:42:53.252Z","trace_propagation_headers":{"sentry-trace":"d5045f6072754a9b958e60f3677f96e4-efc4b721db634bac","baggage":"sentry-trace_id=d5045f6072754a9b958e60f3677f96e4,sentry-release=Unknown"},"correlation_id":"01KZR382DNDWAJN3C2GFH7AN01","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8935604a98c45c0cbcf81b08df1796a59d874078f908b0056845044d563f13d9","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:53.258Z","job_size_bytes":2507,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-5cbb5842a5efac5e2ee5058a: start","job_status":"start","queue_duration_s":0.285639,"scheduling_latency_s":0.285663}1848gitlab # [ 214.704542] gitaly[1381]: time="2026-08-11T09:42:53.592Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1194 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZR385T1SMEHH6CJWGKR3RQ4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T09:42:53.573" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc1849gitlab # [ 214.726411] gitaly[1381]: time="2026-08-11T09:42:53.593Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1194 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZR385T1SMEHH6CJWGKR3RQ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T09:42:53.573" grpc.time_ms=20.064 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc1850gitlab # [ 214.749924] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:53.667Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","3fd9690ac8eb33c66c237f42"],"class":"WebHooks::LogExecutionWorker","jid":"5cbb5842a5efac5e2ee5058a","created_at":"2026-08-11T09:42:53.252Z","trace_propagation_headers":{"sentry-trace":"d5045f6072754a9b958e60f3677f96e4-efc4b721db634bac","baggage":"sentry-trace_id=d5045f6072754a9b958e60f3677f96e4,sentry-release=Unknown"},"correlation_id":"01KZR382DNDWAJN3C2GFH7AN01","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8935604a98c45c0cbcf81b08df1796a59d874078f908b0056845044d563f13d9","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:53.258Z","job_size_bytes":2507,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-5cbb5842a5efac5e2ee5058a: done: 0.122663 sec","job_status":"done","queue_duration_s":0.285639,"scheduling_latency_s":0.285663,"redis_calls":10,"redis_duration_s":0.003029,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000451,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001875,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000703,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.029,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.029,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.098869,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00044894,"duration_s":0.122663,"completed_at":"2026-08-11T09:42:53.667Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011021,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1851gitlab # [ 214.822528] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:53.669Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"b7d0fdbff285f7ec5b4361dc","created_at":"2026-08-11T09:42:53.436Z","trace_propagation_headers":{"sentry-trace":"30d80c8e4d434c7c9229c0954daeac6b-043a710e991449ce","baggage":"sentry-trace_id=30d80c8e4d434c7c9229c0954daeac6b,sentry-release=Unknown"},"correlation_id":"01KZR383KPFT8VE9H5HD6KRQK3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:53.440Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-b7d0fdbff285f7ec5b4361dc: start","job_status":"start","queue_duration_s":0.228601,"scheduling_latency_s":0.228625}1852gitlab # [ 214.896239] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:53.706Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"b7d0fdbff285f7ec5b4361dc","created_at":"2026-08-11T09:42:53.436Z","trace_propagation_headers":{"sentry-trace":"30d80c8e4d434c7c9229c0954daeac6b-043a710e991449ce","baggage":"sentry-trace_id=30d80c8e4d434c7c9229c0954daeac6b,sentry-release=Unknown"},"correlation_id":"01KZR383KPFT8VE9H5HD6KRQK3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:53.440Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-b7d0fdbff285f7ec5b4361dc: done: 0.037339 sec","job_status":"done","queue_duration_s":0.228601,"scheduling_latency_s":0.228625,"redis_calls":10,"redis_duration_s":0.0025210000000000002,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000506,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001541,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000474,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022318,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000415416,"duration_s":0.037339,"completed_at":"2026-08-11T09:42:53.706Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006095,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1853gitlab # [ 214.964357] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:42:53 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 821854gitlab # [ 214.965742] gitlab-workhorse[1283]: time="2026-08-11T09:42:53Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2161855gitlab # [ 214.966854] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:42:53 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.54.0" 641856gitlab # [ 214.968056] gitaly[1381]: time="2026-08-11T09:42:53.771Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=4 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KZR385ZTWFCMGSXFAQX9NZRV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T09:42:53.749" grpc.time_ms=21.958 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc1857gitlab # [ 214.968849] gitaly[1381]: time="2026-08-11T09:42:53.838Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR3862FR6YJZXHZCN8EKWSH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T09:42:53.822" pid=1381 remote_ip="2001:db8:1::1" request_sha=f1e6bb59289c4d43fc3699ed3fc4760ee01ef0e9 response_bytes=216 span.kind=server system=grpc1858gitlab # [ 214.969988] gitaly[1381]: time="2026-08-11T09:42:53.838Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1162 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZR3862FR6YJZXHZCN8EKWSH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T09:42:53.822" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc1859gitlab # [ 215.048524] gitaly[1381]: time="2026-08-11T09:42:53.839Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1162 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KZR3862FR6YJZXHZCN8EKWSH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T09:42:53.822" grpc.time_ms=17.042 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc1860gitlab # [ 215.050122] nixbot[3159]: {"ts": "2026-08-11T09:42:53.928Z", "level": "info", "logger": "nixbot.canceller", "msg": "cancelling build", "build_id": 1, "reason": "superseded"}1861gitlab # [ 215.091718] nix-daemon[3473]: unexpected Nix daemon error: error: interrupted by the user1862gitlab # [ 215.128098] gitaly[1381]: time="2026-08-11T09:42:54.079Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR3867CCAWSBE69P1JZYD9W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T09:43:24.078" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:54.078" grpc.time_ms=0.558 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1863gitlab # [ 215.145496] gitaly[1381]: time="2026-08-11T09:42:54.096Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=648 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR3867CCAWSBE69P1JZYD9W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-11T09:43:24.088" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T09:42:54.088" grpc.time_ms=8.144 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1864gitlab # [ 215.153115] gitaly[1381]: time="2026-08-11T09:42:54.104Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR386B0MMHV9T6AAZ76NBSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T09:43:24.102" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:54.102" grpc.time_ms=1.745 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1865gitlab # [ 215.157073] gitaly[1381]: time="2026-08-11T09:42:54.108Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR3867CCAWSBE69P1JZYD9W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T09:43:04.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T09:42:54.103" grpc.time_ms=5.313 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1866gitlab # [ 215.174959] gitaly[1381]: time="2026-08-11T09:42:54.126Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KZR3867CCAWSBE69P1JZYD9W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-11T09:43:04.025" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T09:42:54.126" grpc.time_ms=0.29 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1867gitlab # [ 215.216060] gitaly[1381]: time="2026-08-11T09:42:54.167Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=620 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KZR3867CCAWSBE69P1JZYD9W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-11T09:43:04.059" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T09:42:54.160" grpc.time_ms=6.903 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1868gitlab # [ 215.251862] gitaly[1381]: time="2026-08-11T09:42:54.203Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR3867CCAWSBE69P1JZYD9W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T09:42:54.202" grpc.time_ms=0.402 pid=1381 span.kind=server system=grpc1869gitlab # [ 215.292740] gitaly[1381]: time="2026-08-11T09:42:54.244Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR3867CCAWSBE69P1JZYD9W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4157 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T09:42:54.243" grpc.time_ms=0.94 pid=1381 span.kind=server system=grpc1870gitlab # [ 215.318039] gitaly[1381]: time="2026-08-11T09:42:54.269Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR3867CCAWSBE69P1JZYD9W diskcache=ba3f8707-758d-4661-bbd7-95c0a3d7b527 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-11T09:43:04.069" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T09:42:54.170" pid=1381 ref=refs/keep-around/f40b211475671ebb570f445080aee2bc707d4975 remote_ip="2001:db8:1::1" revision=f40b211475671ebb570f445080aee2bc707d4975 span.kind=server system=grpc username=root1871gitlab # [ 215.319215] gitaly[1381]: time="2026-08-11T09:42:54.269Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=72 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5190 command.oublock=8 command.real_time_ms=88 command.spawn_token_fork_ms=0 command.system_time_ms=45 command.user_time_ms=27 component=gitaly.UnaryServerInterceptor correlation_id=01KZR3867CCAWSBE69P1JZYD9W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-11T09:43:04.069" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-11T09:42:54.170" grpc.time_ms=99.685 pid=1381 ref=refs/keep-around/f40b211475671ebb570f445080aee2bc707d4975 remote_ip="2001:db8:1::1" revision=f40b211475671ebb570f445080aee2bc707d4975 span.kind=server system=grpc username=root1872gitlab # [ 215.323643] gitaly[1381]: time="2026-08-11T09:42:54.275Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR3867CCAWSBE69P1JZYD9W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T09:43:24.274" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:54.274" grpc.time_ms=0.361 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1873gitlab # [ 215.331674] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:54.282Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"74f156defa290d2837075c48","created_at":"2026-08-11T09:42:54.277Z","trace_propagation_headers":{"sentry-trace":"9bb3777d54c0428695d31d0472ccc72c-5878ceba111a4fe5","baggage":"sentry-trace_id=9bb3777d54c0428695d31d0472ccc72c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR3867CCAWSBE69P1JZYD9W","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:54.280Z","job_size_bytes":65,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-74f156defa290d2837075c48: start","job_status":"start","queue_duration_s":0.001852,"scheduling_latency_s":0.0019}1874gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f40b211475671ebb570f445080aee2bc707d4975'1875gitlab # [ 215.355132] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:54.306Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"74f156defa290d2837075c48","created_at":"2026-08-11T09:42:54.277Z","trace_propagation_headers":{"sentry-trace":"9bb3777d54c0428695d31d0472ccc72c-5878ceba111a4fe5","baggage":"sentry-trace_id=9bb3777d54c0428695d31d0472ccc72c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR3867CCAWSBE69P1JZYD9W","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:54.280Z","job_size_bytes":65,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-74f156defa290d2837075c48: done: 0.024168 sec","job_status":"done","queue_duration_s":0.001852,"scheduling_latency_s":0.0019,"redis_calls":7,"redis_duration_s":0.002085,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001634,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000451,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014869,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024168,"completed_at":"2026-08-11T09:42:54.306Z","load_balancing_strategy":"primary","db_duration_s":0.002491,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1876gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=f40b211475671ebb570f445080aee2bc707d4975', in 0.06 seconds)1877(finished: subtest: push delivers the webhook, in 4.62 seconds)1878subtest: eval and build post commit statuses1879gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f40b211475671ebb570f445080aee2bc707d4975/statuses1880gitlab # [ 215.446457] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:54.308Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"6e5b7acdda9cb7646a606041","created_at":"2026-08-11T09:42:54.281Z","trace_propagation_headers":{"sentry-trace":"9bb3777d54c0428695d31d0472ccc72c-5878ceba111a4fe5","baggage":"sentry-trace_id=9bb3777d54c0428695d31d0472ccc72c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR3867CCAWSBE69P1JZYD9W","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:54.285Z","job_size_bytes":65,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-6e5b7acdda9cb7646a606041: start","job_status":"start","queue_duration_s":0.022384,"scheduling_latency_s":0.022407}1881gitlab # [ 215.447744] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:54.361Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"6e5b7acdda9cb7646a606041","created_at":"2026-08-11T09:42:54.281Z","trace_propagation_headers":{"sentry-trace":"9bb3777d54c0428695d31d0472ccc72c-5878ceba111a4fe5","baggage":"sentry-trace_id=9bb3777d54c0428695d31d0472ccc72c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR3867CCAWSBE69P1JZYD9W","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:54.285Z","job_size_bytes":65,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-6e5b7acdda9cb7646a606041: done: 0.053067 sec","job_status":"done","queue_duration_s":0.022384,"scheduling_latency_s":0.022407,"redis_calls":10,"redis_duration_s":0.003759,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.0023,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001459,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03393,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.053067,"completed_at":"2026-08-11T09:42:54.361Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011408,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1882gitlab # [ 215.530329] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:54.363Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"0344b53be206d71b5471454b","created_at":"2026-08-11T09:42:54.332Z","trace_propagation_headers":{"sentry-trace":"9bb3777d54c0428695d31d0472ccc72c-5878ceba111a4fe5","baggage":"sentry-trace_id=9bb3777d54c0428695d31d0472ccc72c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR3867CCAWSBE69P1JZYD9W","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:54.336Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0344b53be206d71b5471454b: start","job_status":"start","queue_duration_s":0.026671,"scheduling_latency_s":0.026703}1883gitlab # [ 215.532395] nixbot[3159]: {"ts": "2026-08-11T09:42:54.350Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f40b211475671ebb570f445080aee2bc707d4975 \"HTTP/1.1 201 Created\""}1884gitlab # [ 215.537146] nixbot[3159]: {"ts": "2026-08-11T09:42:54.359Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-f40b21147567-1"}1885gitlab # [ 215.537940] nixbot[3159]: INFO: ::ffff:127.0.0.1:38926 - "GET /api/repos/gitlab/root/test-flake/builds?commit=f40b211475671ebb570f445080aee2bc707d4975 HTTP/1.1" 200 OK1886gitlab # [ 215.541501] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:42:54 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f40b211475671ebb570f445080aee2bc707d4975 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 4201887gitlab # [ 215.542556] gitaly[1381]: time="2026-08-11T09:42:54.412Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=132 command.spawn_token_fork_ms=124 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR386B0MMHV9T6AAZ76NBSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T09:43:04.238" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T09:42:54.278" grpc.time_ms=133.642 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1888gitlab # [ 215.558186] nix-daemon[3434]: accepted connection from pid 3555, user nixbot1889gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f40b211475671ebb570f445080aee2bc707d4975/statuses, in 0.14 seconds)1890gitlab # [ 215.560258] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:54.500Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"0344b53be206d71b5471454b","created_at":"2026-08-11T09:42:54.332Z","trace_propagation_headers":{"sentry-trace":"9bb3777d54c0428695d31d0472ccc72c-5878ceba111a4fe5","baggage":"sentry-trace_id=9bb3777d54c0428695d31d0472ccc72c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR3867CCAWSBE69P1JZYD9W","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:54.336Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0344b53be206d71b5471454b: done: 0.137984 sec","job_status":"done","queue_duration_s":0.026671,"scheduling_latency_s":0.026703,"gitaly_calls":3,"gitaly_duration_s":0.009122,"redis_calls":44,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.011262,"redis_read_bytes":98,"redis_write_bytes":6014,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001775,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":20,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.002457,"redis_cache_read_bytes":38,"redis_cache_write_bytes":1784,"redis_queues_calls":2,"redis_queues_duration_s":0.00035,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002829,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000247,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000685,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001144,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":31,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":31,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":19,"db_ci_count":12,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.084515,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.114312015,"duration_s":0.137984,"completed_at":"2026-08-11T09:42:54.500Z","load_balancing_strategy":"primary","db_duration_s":0.034081,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1891gitlab # [ 215.670313] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:54.504Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"a73177774bede57783b7b671","created_at":"2026-08-11T09:42:54.409Z","trace_propagation_headers":{"sentry-trace":"9bb3777d54c0428695d31d0472ccc72c-122229df2a65485a","baggage":"sentry-trace_id=9bb3777d54c0428695d31d0472ccc72c,sentry-release=Unknown"},"correlation_id":"01KZR3867CCAWSBE69P1JZYD9W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:54.412Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-a73177774bede57783b7b671: start","job_status":"start","queue_duration_s":0.091735,"scheduling_latency_s":0.09176}1892gitlab # [ 215.671854] gitaly[1381]: time="2026-08-11T09:42:54.425Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR3867CCAWSBE69P1JZYD9W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T09:43:24.123" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:54.424" grpc.time_ms=1.264 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1893gitlab # [ 215.684863] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:42:54 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/075c9ab1f688abeabd7100784bc099321ae5e1e8 HTTP/1.1" 201 651 "" "python-httpx/0.28.1" 5081894gitlab # [ 215.689041] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:42:54 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/f40b211475671ebb570f445080aee2bc707d4975/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 1161895gitlab # [ 215.693101] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:54.556Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"a73177774bede57783b7b671","created_at":"2026-08-11T09:42:54.409Z","trace_propagation_headers":{"sentry-trace":"9bb3777d54c0428695d31d0472ccc72c-122229df2a65485a","baggage":"sentry-trace_id=9bb3777d54c0428695d31d0472ccc72c,sentry-release=Unknown"},"correlation_id":"01KZR3867CCAWSBE69P1JZYD9W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:54.412Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-a73177774bede57783b7b671: done: 0.052785 sec","job_status":"done","queue_duration_s":0.091735,"scheduling_latency_s":0.09176,"redis_calls":7,"redis_duration_s":0.005595,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005005,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00059,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02309,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.052785,"completed_at":"2026-08-11T09:42:54.556Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009259,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1896gitlab # [ 215.814152] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:54.558Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"6c8b8d2dcb4ad9e6be7443cc","created_at":"2026-08-11T09:42:54.515Z","trace_propagation_headers":{"sentry-trace":"10056b14fdee41c0a26a707a9539a500-f1a37fed47974e1f","baggage":"sentry-trace_id=10056b14fdee41c0a26a707a9539a500,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR386B0MMHV9T6AAZ76NBSF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:54.523Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-6c8b8d2dcb4ad9e6be7443cc: start","job_status":"start","queue_duration_s":0.035367,"scheduling_latency_s":0.035399}1897gitlab # [ 215.815542] nixbot[3159]: {"ts": "2026-08-11T09:42:54.548Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-f40b21147567-1", "argv0": "bwrap"}1898gitlab # [ 215.816819] nix-daemon[3434]: accepted connection from pid 3566, user nixbot1899gitlab # [ 215.817971] gitaly[1381]: time="2026-08-11T09:42:54.454Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR3867CCAWSBE69P1JZYD9W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T09:43:24.153" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:54.453" grpc.time_ms=0.543 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1900gitlab # [ 215.819133] gitaly[1381]: time="2026-08-11T09:42:54.489Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR3867CCAWSBE69P1JZYD9W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T09:43:24.188" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:54.488" grpc.time_ms=0.785 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1901gitlab # [ 215.830206] gitaly[1381]: time="2026-08-11T09:42:54.555Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR386R0RAMH2W49TYVMNKTX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T09:43:24.253" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:54.554" grpc.time_ms=0.886 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1902gitlab # [ 215.850144] gitaly[1381]: time="2026-08-11T09:42:54.660Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR386B0MMHV9T6AAZ76NBSF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3899 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T09:42:54.660" grpc.time_ms=0.356 pid=1381 span.kind=server system=grpc1903gitlab # [ 215.865496] gitaly[1381]: time="2026-08-11T09:42:54.687Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR386B0MMHV9T6AAZ76NBSF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T09:42:54.687" grpc.time_ms=0.284 pid=1381 span.kind=server system=grpc1904gitlab # [ 215.880991] gitaly[1381]: time="2026-08-11T09:42:54.715Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR386B0MMHV9T6AAZ76NBSF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3899 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T09:42:54.714" grpc.time_ms=0.586 pid=1381 span.kind=server system=grpc1905gitlab # [ 215.956658] gitaly[1381]: time="2026-08-11T09:42:54.728Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR386B0MMHV9T6AAZ76NBSF diskcache=aa5b8cb9-48a7-4cb3-9e69-b88b1743765c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T09:43:24.329" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-11T09:42:54.630" pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1906gitlab # [ 215.958064] gitaly[1381]: time="2026-08-11T09:42:54.729Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=97 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7411 command.oublock=0 command.real_time_ms=88 command.spawn_token_fork_ms=0 command.system_time_ms=61 command.user_time_ms=36 component=gitaly.UnaryServerInterceptor correlation_id=01KZR386B0MMHV9T6AAZ76NBSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T09:43:24.329" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T09:42:54.630" grpc.time_ms=98.466 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1907gitlab # [ 215.959220] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:54.860Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"6c8b8d2dcb4ad9e6be7443cc","created_at":"2026-08-11T09:42:54.515Z","trace_propagation_headers":{"sentry-trace":"10056b14fdee41c0a26a707a9539a500-f1a37fed47974e1f","baggage":"sentry-trace_id=10056b14fdee41c0a26a707a9539a500,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR386B0MMHV9T6AAZ76NBSF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:54.523Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-6c8b8d2dcb4ad9e6be7443cc: done: 0.301686 sec","job_status":"done","queue_duration_s":0.035367,"scheduling_latency_s":0.035399,"gitaly_calls":4,"gitaly_duration_s":0.110196,"redis_calls":98,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.019988,"redis_read_bytes":179,"redis_write_bytes":22256,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.00113,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":17,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.001462,"redis_cache_read_bytes":33,"redis_cache_write_bytes":1526,"redis_feature_flag_calls":22,"redis_feature_flag_duration_s":0.005061,"redis_feature_flag_read_bytes":22,"redis_feature_flag_write_bytes":3871,"redis_queues_calls":20,"redis_queues_duration_s":0.002891,"redis_queues_read_bytes":21,"redis_queues_write_bytes":11295,"redis_queues_metadata_calls":18,"redis_queues_metadata_duration_s":0.004739,"redis_queues_metadata_read_bytes":28,"redis_queues_metadata_write_bytes":2886,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000239,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.0007,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002636,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":850,"db_count":47,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.035,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":15,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.011,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.013,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.143673,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.274807832,"duration_s":0.301686,"completed_at":"2026-08-11T09:42:54.860Z","load_balancing_strategy":"primary","db_duration_s":0.038132,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1908gitlab # [ 216.028299] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:54.862Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"2cc5bb69e24ad45fc4cf6a2b","created_at":"2026-08-11T09:42:54.617Z","trace_propagation_headers":{"sentry-trace":"10056b14fdee41c0a26a707a9539a500-a8736663696b4f5a","baggage":"sentry-trace_id=10056b14fdee41c0a26a707a9539a500,sentry-release=Unknown"},"correlation_id":"01KZR386B0MMHV9T6AAZ76NBSF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:54.621Z","job_size_bytes":23,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-2cc5bb69e24ad45fc4cf6a2b: start","job_status":"start","queue_duration_s":0.240681,"scheduling_latency_s":0.240705}1909gitlab # [ 216.096600] gitaly[1381]: time="2026-08-11T09:42:54.795Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR386B0MMHV9T6AAZ76NBSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T09:43:24.493" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:54.794" grpc.time_ms=0.872 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1910gitlab # [ 216.097980] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:54.944Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"2cc5bb69e24ad45fc4cf6a2b","created_at":"2026-08-11T09:42:54.617Z","trace_propagation_headers":{"sentry-trace":"10056b14fdee41c0a26a707a9539a500-a8736663696b4f5a","baggage":"sentry-trace_id=10056b14fdee41c0a26a707a9539a500,sentry-release=Unknown"},"correlation_id":"01KZR386B0MMHV9T6AAZ76NBSF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:54.621Z","job_size_bytes":23,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-2cc5bb69e24ad45fc4cf6a2b: done: 0.082731 sec","job_status":"done","queue_duration_s":0.240681,"scheduling_latency_s":0.240705,"redis_calls":15,"redis_duration_s":0.003402,"redis_read_bytes":13,"redis_write_bytes":3012,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000456,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_calls":2,"redis_queues_duration_s":0.000347,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1627,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001649,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":742,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000509,"redis_rate_limiting_write_bytes":148,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000441,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":13,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":13,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.064418,"worker_id":"sidekiq_0","rate_limiting_gates":["permanent_email_failure","temporary_email_failure"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000343619,"duration_s":0.082731,"completed_at":"2026-08-11T09:42:54.944Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012167,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1911gitlab # [ 216.131766] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:54.946Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"b56291720287ce1f18b2fab4","created_at":"2026-08-11T09:42:54.936Z","trace_propagation_headers":{"sentry-trace":"10056b14fdee41c0a26a707a9539a500-1c7fadb0ae954a0f","baggage":"sentry-trace_id=10056b14fdee41c0a26a707a9539a500,sentry-release=Unknown"},"correlation_id":"01KZR386B0MMHV9T6AAZ76NBSF","meta.caller_id":"PipelineNotificationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:9a1b72be10d38b92b807a7184da4ebd28f125d8ff73416005d48ece04dac8cf5","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:54.938Z","job_size_bytes":464,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-b56291720287ce1f18b2fab4: start","job_status":"start","queue_duration_s":0.007606,"scheduling_latency_s":0.007628}1912gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f40b211475671ebb570f445080aee2bc707d4975/statuses1913gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f40b211475671ebb570f445080aee2bc707d4975/statuses, in 0.09 seconds)1914gitlab # [ 216.158145] sidekiq-cluster[2141]: {"severity":"WARN","time":"2026-08-11T09:42:54.977Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"b56291720287ce1f18b2fab4","created_at":"2026-08-11T09:42:54.936Z","trace_propagation_headers":{"sentry-trace":"10056b14fdee41c0a26a707a9539a500-1c7fadb0ae954a0f","baggage":"sentry-trace_id=10056b14fdee41c0a26a707a9539a500,sentry-release=Unknown"},"correlation_id":"01KZR386B0MMHV9T6AAZ76NBSF","meta.caller_id":"PipelineNotificationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:9a1b72be10d38b92b807a7184da4ebd28f125d8ff73416005d48ece04dac8cf5","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:54.938Z","job_size_bytes":464,"pid":2141,"sidekiq_tid":"m2vx","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-b56291720287ce1f18b2fab4: fail: 0.031204 sec","job_status":"fail","queue_duration_s":0.007606,"scheduling_latency_s":0.007628,"redis_calls":7,"redis_duration_s":0.001626,"redis_read_bytes":5,"redis_write_bytes":786,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001162,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000464,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":250,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020026,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031204,"completed_at":"2026-08-11T09:42:54.977Z","load_balancing_strategy":"primary_no_wal","exception.class":"ArgumentError","exception.message":":arguments expected to be an Array of individual string args","exception.backtrace":["/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/network/delivery_methods/sendmail.rb:53:in `initialize'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `new'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `delivery_method'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:66:in `wrap_delivery_behavior'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:80:in `wrap_delivery_behavior!'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:876:in `mail'","app/mailers/application_mailer.rb:85:in `block in mail_with_locale'","lib/gitlab/i18n.rb:116:in `with_locale'","app/mailers/application_mailer.rb:84:in `mail_with_locale'","app/mailers/notify.rb:293:in `email_with_layout'","app/mailers/emails/pipelines.rb:33:in `pipeline_mail'","app/mailers/emails/pipelines.rb:10:in `pipeline_failed_email'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:215:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:261:in `block in process_action'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","lib/gitlab/i18n.rb:116:in `with_locale'","lib/gitlab/i18n.rb:126:in `with_default_locale'","app/mailers/application_mailer.rb:60:in `render_with_default_locale'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:260:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:152:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:29:in `block in process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:21:in `handle_exceptions'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:28:in `process'","/nix/store/abbaw4w9gll6p923md75p3h3rrmhrdqn-ruby3.3-actionview-7.2.3/lib/ruby/gems/3.3.0/gems/actionview-7.2.3/lib/action_view/rendering.rb:40:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:652:in `block in process'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:651:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:136:in `block in processed_mailer'","\u003cinternal:kernel\u003e:90:in `tap'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:135:in `processed_mailer'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:124:in `deliver_now'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/mail_delivery_job.rb:28:in `perform'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:68:in `block in _perform_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/railtie.rb:32:in `block (2 levels) in insert_into_active_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/bqz31s23z0jk4464lbybyz83ikl0gmyd-ruby3.3-i18n-1.14.7/lib/ruby/gems/3.3.0/gems/i18n-1.14.7/lib/i18n.rb:353:in `with_locale'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/translation.rb:9:in `block (2 levels) in \u003cmodule:Translation\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/core_ext/time/zones.rb:65:in `use_zone'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/timezones.rb:9:in `block (2 levels) in \u003cmodule:Timezones\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:67:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:32:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:51:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `block in perform_now'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:13:in `block in instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:40:in `block in instrument'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:39:in `instrument'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:11:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `block in perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:41:in `tag_logger'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `perform_now'","/nix/store/wp2rnxa243q2gn2f8h04d48hnvfr0387-ruby3.3-sentry-rails-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-rails-5.23.0/lib/sentry/rails/active_job.rb:8:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:29:in `block in execute'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:79:in `block (4 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:87:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:78:in `block (3 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:27:in `execute'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:13:in `perform'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:220:in `execute_job'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:185:in `block (4 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/current_organization/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/identity/restore.rb:12:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/resource_usage_limit/middleware.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/resource_usage_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/database/load_balancing/sidekiq_server_middleware.rb:35:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/skip_jobs.rb:51:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/throttling/middleware.rb:18:in `perform'","lib/gitlab/sidekiq_middleware/throttling/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/pause_control/strategies/base.rb:31:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/strategy_handler.rb:22:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/duplicate_jobs/strategies/until_executing.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/duplicate_job.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/concurrency_limit/middleware.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/concurrency_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/click_house/migration_support/sidekiq_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/worker_context.rb:9:in `wrap_in_optional_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:19:in `block in call'","lib/gitlab/application_context.rb:185:in `block in use'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","lib/gitlab/application_context.rb:185:in `use'","lib/gitlab/application_context.rb:105:in `with_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:17:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_status/server_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_versioning/middleware.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `block in call'","lib/gitlab/database/query_analyzer.rb:94:in `within'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/admin_mode/server.rb:14:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/set_ip_address.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/instrumentation_logger.rb:10:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/batch_loader.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/extra_done_log_metadata.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/server_metrics.rb:112:in `block in call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `block in instrument'","lib/gitlab/metrics/background_transaction.rb:33:in `run'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `instrument'","lib/gitlab/sidekiq_middleware/server_metrics.rb:111:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:8:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:66:in `enabling_request_store'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:59:in `ensure_request_store'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:22:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/user_experience_sli/server.rb:16:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:16:in `block in call'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:15:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/monitor.rb:10:in `block in call'","lib/gitlab/sidekiq_daemon/monitor.rb:46:in `within_job'","lib/gitlab/sidekiq_middleware/monitor.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:10:in `block in call'","lib/gitlab/sidekiq_sharding/validator.rb:42:in `enabled'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/size_limiter/server.rb:13:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/sidekiq_instrumentation.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/85h4805ad7n5qn7wq2m6icypga7rnk80-ruby3.3-sentry-sidekiq-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-sidekiq-5.23.0/lib/sentry/sidekiq/sentry_context_middleware.rb:54:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job/interrupt_handler.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:26:in `track'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:134:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:184:in `block (3 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:145:in `block (6 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:118:in `local'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:144:in `block (5 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:27:in `block in call'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:91:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:26:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:139:in `block (4 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:281:in `stats'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:134:in `block (3 levels) in dispatch'","lib/gitlab/sidekiq_logging/structured_logger.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:133:in `block (2 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:85:in `global'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:132:in `block in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_logger.rb:40:in `prepare'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:131:in `dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:183:in `block (2 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `block in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:86:in `process_one'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:76:in `run'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:10:in `watchdog'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:19:in `block in safe_thread'"],"db_duration_s":0.004865,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1915gitlab # [ 216.775353] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:54.980Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"21f1edcfcf0ff50488319df0","created_at":"2026-08-11T09:42:54.734Z","trace_propagation_headers":{"sentry-trace":"10056b14fdee41c0a26a707a9539a500-a8736663696b4f5a","baggage":"sentry-trace_id=10056b14fdee41c0a26a707a9539a500,sentry-release=Unknown"},"correlation_id":"01KZR386B0MMHV9T6AAZ76NBSF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:54.739Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m5o5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-21f1edcfcf0ff50488319df0: start","job_status":"start","queue_duration_s":0.241494,"scheduling_latency_s":0.241582}1916gitlab # [ 216.776784] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:55.010Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"21f1edcfcf0ff50488319df0","created_at":"2026-08-11T09:42:54.734Z","trace_propagation_headers":{"sentry-trace":"10056b14fdee41c0a26a707a9539a500-a8736663696b4f5a","baggage":"sentry-trace_id=10056b14fdee41c0a26a707a9539a500,sentry-release=Unknown"},"correlation_id":"01KZR386B0MMHV9T6AAZ76NBSF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:54.739Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m5o5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-21f1edcfcf0ff50488319df0: done: 0.030164 sec","job_status":"done","queue_duration_s":0.241494,"scheduling_latency_s":0.241582,"redis_calls":10,"redis_duration_s":0.00232,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000437,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001415,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000468,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018386,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000419886,"duration_s":0.030164,"completed_at":"2026-08-11T09:42:55.010Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003059,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1917gitlab # [ 216.845930] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:55.012Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"31c577b531945bf6946036d9","created_at":"2026-08-11T09:42:54.751Z","trace_propagation_headers":{"sentry-trace":"10056b14fdee41c0a26a707a9539a500-a8736663696b4f5a","baggage":"sentry-trace_id=10056b14fdee41c0a26a707a9539a500,sentry-release=Unknown"},"correlation_id":"01KZR386B0MMHV9T6AAZ76NBSF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:54.757Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m5o5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-31c577b531945bf6946036d9: start","job_status":"start","queue_duration_s":0.255041,"scheduling_latency_s":0.255063}1918gitlab # [ 216.871409] gitaly[1381]: time="2026-08-11T09:42:54.817Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR386B0MMHV9T6AAZ76NBSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T09:43:24.516" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:54.817" grpc.time_ms=0.643 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1919gitlab # [ 216.947778] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:42:55 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/f40b211475671ebb570f445080aee2bc707d4975/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 591920gitlab # [ 216.949134] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:55.330Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"31c577b531945bf6946036d9","created_at":"2026-08-11T09:42:54.751Z","trace_propagation_headers":{"sentry-trace":"10056b14fdee41c0a26a707a9539a500-a8736663696b4f5a","baggage":"sentry-trace_id=10056b14fdee41c0a26a707a9539a500,sentry-release=Unknown"},"correlation_id":"01KZR386B0MMHV9T6AAZ76NBSF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:54.757Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m5o5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-31c577b531945bf6946036d9: done: 0.318242 sec","job_status":"done","queue_duration_s":0.255041,"scheduling_latency_s":0.255063,"redis_calls":10,"redis_duration_s":0.0025770000000000003,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000475,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001618,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000484,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.286,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.285,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025477,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000440839,"duration_s":0.318242,"completed_at":"2026-08-11T09:42:55.330Z","load_balancing_strategy":"primary","db_duration_s":0.285477,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1921gitlab # [ 216.961147] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:55.332Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"9817361b44b671bec53ea9e3","created_at":"2026-08-11T09:42:54.767Z","trace_propagation_headers":{"sentry-trace":"10056b14fdee41c0a26a707a9539a500-a8736663696b4f5a","baggage":"sentry-trace_id=10056b14fdee41c0a26a707a9539a500,sentry-release=Unknown"},"correlation_id":"01KZR386B0MMHV9T6AAZ76NBSF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:54.772Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m5o5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-9817361b44b671bec53ea9e3: start","job_status":"start","queue_duration_s":0.560283,"scheduling_latency_s":0.560305}1922gitlab # [ 216.986131] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:55.363Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"9817361b44b671bec53ea9e3","created_at":"2026-08-11T09:42:54.767Z","trace_propagation_headers":{"sentry-trace":"10056b14fdee41c0a26a707a9539a500-a8736663696b4f5a","baggage":"sentry-trace_id=10056b14fdee41c0a26a707a9539a500,sentry-release=Unknown"},"correlation_id":"01KZR386B0MMHV9T6AAZ76NBSF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:54.772Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m5o5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-9817361b44b671bec53ea9e3: done: 0.030736 sec","job_status":"done","queue_duration_s":0.560283,"scheduling_latency_s":0.560305,"redis_calls":13,"redis_duration_s":0.003066,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000468,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001501,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000651,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000446,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01987,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00038301,"duration_s":0.030736,"completed_at":"2026-08-11T09:42:55.363Z","load_balancing_strategy":"primary","db_duration_s":0.004266,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1923gitlab # [ 217.088945] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:55.364Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"9ea0b7880383a9267c63ddea","created_at":"2026-08-11T09:42:54.772Z","trace_propagation_headers":{"sentry-trace":"10056b14fdee41c0a26a707a9539a500-a8736663696b4f5a","baggage":"sentry-trace_id=10056b14fdee41c0a26a707a9539a500,sentry-release=Unknown"},"correlation_id":"01KZR386B0MMHV9T6AAZ76NBSF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:54.776Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m5o5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-9ea0b7880383a9267c63ddea: start","job_status":"start","queue_duration_s":0.588484,"scheduling_latency_s":0.588504}1924gitlab # [ 217.090213] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:55.391Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"9ea0b7880383a9267c63ddea","created_at":"2026-08-11T09:42:54.772Z","trace_propagation_headers":{"sentry-trace":"10056b14fdee41c0a26a707a9539a500-a8736663696b4f5a","baggage":"sentry-trace_id=10056b14fdee41c0a26a707a9539a500,sentry-release=Unknown"},"correlation_id":"01KZR386B0MMHV9T6AAZ76NBSF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:54.776Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m5o5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-9ea0b7880383a9267c63ddea: done: 0.026609 sec","job_status":"done","queue_duration_s":0.588484,"scheduling_latency_s":0.588504,"redis_calls":10,"redis_duration_s":0.002502,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000504,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001561,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000437,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015405,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000389714,"duration_s":0.026609,"completed_at":"2026-08-11T09:42:55.391Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003264,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1925gitlab # [ 217.151121] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:55.392Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"dbb009ba2def8a1febb33634","created_at":"2026-08-11T09:42:54.776Z","trace_propagation_headers":{"sentry-trace":"10056b14fdee41c0a26a707a9539a500-a8736663696b4f5a","baggage":"sentry-trace_id=10056b14fdee41c0a26a707a9539a500,sentry-release=Unknown"},"correlation_id":"01KZR386B0MMHV9T6AAZ76NBSF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:54.780Z","job_size_bytes":19,"pid":2141,"sidekiq_tid":"m5o5","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-dbb009ba2def8a1febb33634: start","job_status":"start","queue_duration_s":0.612141,"scheduling_latency_s":0.612162}1926gitlab # [ 217.230268] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:55.427Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"dbb009ba2def8a1febb33634","created_at":"2026-08-11T09:42:54.776Z","trace_propagation_headers":{"sentry-trace":"10056b14fdee41c0a26a707a9539a500-a8736663696b4f5a","baggage":"sentry-trace_id=10056b14fdee41c0a26a707a9539a500,sentry-release=Unknown"},"correlation_id":"01KZR386B0MMHV9T6AAZ76NBSF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:54.780Z","job_size_bytes":19,"pid":2141,"sidekiq_tid":"m5o5","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-dbb009ba2def8a1febb33634: done: 0.034393 sec","job_status":"done","queue_duration_s":0.612141,"scheduling_latency_s":0.612162,"redis_calls":11,"redis_duration_s":0.007741,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000498,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.005789,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001454,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018937,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.003028876,"duration_s":0.034393,"completed_at":"2026-08-11T09:42:55.427Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003729,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1927gitlab # [ 217.244079] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:55.429Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"failed\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"261d67860dc14f1e08a15543","created_at":"2026-08-11T09:42:54.782Z","trace_propagation_headers":{"sentry-trace":"10056b14fdee41c0a26a707a9539a500-a8736663696b4f5a","baggage":"sentry-trace_id=10056b14fdee41c0a26a707a9539a500,sentry-release=Unknown"},"correlation_id":"01KZR386B0MMHV9T6AAZ76NBSF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e2e8f76273ed3dffe93170e4a8828cd9c1cde36f18ce9deaf751670cff2f2dad","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:54.786Z","job_size_bytes":65,"pid":2141,"sidekiq_tid":"m5o5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-261d67860dc14f1e08a15543: start","job_status":"start","queue_duration_s":0.643242,"scheduling_latency_s":0.643265}1928gitlab # [ 217.271792] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:55.457Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"failed\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"261d67860dc14f1e08a15543","created_at":"2026-08-11T09:42:54.782Z","trace_propagation_headers":{"sentry-trace":"10056b14fdee41c0a26a707a9539a500-a8736663696b4f5a","baggage":"sentry-trace_id=10056b14fdee41c0a26a707a9539a500,sentry-release=Unknown"},"correlation_id":"01KZR386B0MMHV9T6AAZ76NBSF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e2e8f76273ed3dffe93170e4a8828cd9c1cde36f18ce9deaf751670cff2f2dad","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:54.786Z","job_size_bytes":65,"pid":2141,"sidekiq_tid":"m5o5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-261d67860dc14f1e08a15543: done: 0.028018 sec","job_status":"done","queue_duration_s":0.643242,"scheduling_latency_s":0.643265,"redis_calls":10,"redis_duration_s":0.00235,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000526,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001375,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000449,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017201,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000356191,"duration_s":0.028018,"completed_at":"2026-08-11T09:42:55.457Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003698,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1929gitlab # [ 217.372213] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:55.459Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"7a05ae3fc258df03640b8a15","created_at":"2026-08-11T09:42:54.787Z","trace_propagation_headers":{"sentry-trace":"10056b14fdee41c0a26a707a9539a500-a8736663696b4f5a","baggage":"sentry-trace_id=10056b14fdee41c0a26a707a9539a500,sentry-release=Unknown"},"correlation_id":"01KZR386B0MMHV9T6AAZ76NBSF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:54.788Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m5o5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-7a05ae3fc258df03640b8a15: start","job_status":"start","queue_duration_s":0.670518,"scheduling_latency_s":0.67054}1930gitlab # [ 217.373392] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:55.487Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"7a05ae3fc258df03640b8a15","created_at":"2026-08-11T09:42:54.787Z","trace_propagation_headers":{"sentry-trace":"10056b14fdee41c0a26a707a9539a500-a8736663696b4f5a","baggage":"sentry-trace_id=10056b14fdee41c0a26a707a9539a500,sentry-release=Unknown"},"correlation_id":"01KZR386B0MMHV9T6AAZ76NBSF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:54.788Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m5o5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-7a05ae3fc258df03640b8a15: done: 0.028361 sec","job_status":"done","queue_duration_s":0.670518,"scheduling_latency_s":0.67054,"redis_calls":7,"redis_duration_s":0.0018659999999999998,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001432,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000434,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020175,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028361,"completed_at":"2026-08-11T09:42:55.487Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002881,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1931gitlab # [ 217.433536] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:55.489Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"b666b106d88a6b48d8212c2c","created_at":"2026-08-11T09:42:54.818Z","trace_propagation_headers":{"sentry-trace":"10056b14fdee41c0a26a707a9539a500-a8736663696b4f5a","baggage":"sentry-trace_id=10056b14fdee41c0a26a707a9539a500,sentry-release=Unknown"},"correlation_id":"01KZR386B0MMHV9T6AAZ76NBSF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:54.822Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m5o5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-b666b106d88a6b48d8212c2c: start","job_status":"start","queue_duration_s":0.666821,"scheduling_latency_s":0.666855}1932gitlab # [ 217.512880] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:55.527Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"b666b106d88a6b48d8212c2c","created_at":"2026-08-11T09:42:54.818Z","trace_propagation_headers":{"sentry-trace":"10056b14fdee41c0a26a707a9539a500-a8736663696b4f5a","baggage":"sentry-trace_id=10056b14fdee41c0a26a707a9539a500,sentry-release=Unknown"},"correlation_id":"01KZR386B0MMHV9T6AAZ76NBSF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:54.822Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m5o5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-b666b106d88a6b48d8212c2c: done: 0.038442 sec","job_status":"done","queue_duration_s":0.666821,"scheduling_latency_s":0.666855,"redis_calls":10,"redis_duration_s":0.002465,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000447,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001477,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000541,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017962,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000362337,"duration_s":0.038442,"completed_at":"2026-08-11T09:42:55.527Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011721,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1933gitlab # [ 217.526286] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:55.529Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"6bf5085239113ceda4d58ef9","created_at":"2026-08-11T09:42:54.823Z","trace_propagation_headers":{"sentry-trace":"10056b14fdee41c0a26a707a9539a500-a8736663696b4f5a","baggage":"sentry-trace_id=10056b14fdee41c0a26a707a9539a500,sentry-release=Unknown"},"correlation_id":"01KZR386B0MMHV9T6AAZ76NBSF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:54.826Z","job_size_bytes":6,"pid":2141,"sidekiq_tid":"m5o5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-6bf5085239113ceda4d58ef9: start","job_status":"start","queue_duration_s":0.703131,"scheduling_latency_s":0.703152}1934gitlab # [ 217.551158] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:55.551Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"6bf5085239113ceda4d58ef9","created_at":"2026-08-11T09:42:54.823Z","trace_propagation_headers":{"sentry-trace":"10056b14fdee41c0a26a707a9539a500-a8736663696b4f5a","baggage":"sentry-trace_id=10056b14fdee41c0a26a707a9539a500,sentry-release=Unknown"},"correlation_id":"01KZR386B0MMHV9T6AAZ76NBSF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:54.826Z","job_size_bytes":6,"pid":2141,"sidekiq_tid":"m5o5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-6bf5085239113ceda4d58ef9: done: 0.02211 sec","job_status":"done","queue_duration_s":0.703131,"scheduling_latency_s":0.703152,"redis_calls":10,"redis_duration_s":0.0024549999999999997,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00054,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001447,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000468,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000391391,"duration_s":0.02211,"completed_at":"2026-08-11T09:42:55.551Z","load_balancing_strategy":"primary","db_duration_s":0.002062,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1935gitlab # [ 217.655510] gitaly[1381]: time="2026-08-11T09:42:54.847Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR386B0MMHV9T6AAZ76NBSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T09:43:24.546" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:54.846" grpc.time_ms=0.671 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1936gitlab # [ 217.657127] gitaly[1381]: time="2026-08-11T09:42:55.658Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR387VZMSVPCAZQJ81FZVY9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T09:43:25.355" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:55.656" grpc.time_ms=1.503 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1937gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f40b211475671ebb570f445080aee2bc707d4975/statuses1938gitlab # [ 217.737512] nixbot[3159]: {"ts": "2026-08-11T09:42:56.688Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/075c9ab1f688abeabd7100784bc099321ae5e1e8 \"HTTP/1.1 201 Created\""}1939gitlab # [ 217.800068] nix-daemon[3434]: accepted connection from pid 3627, user nixbot1940gitlab # [ 217.804568] gitaly[1381]: time="2026-08-11T09:42:56.756Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR388XSEH43G7KSBF1ZJJSA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T09:43:26.751" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:56.752" grpc.time_ms=3.388 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1941gitlab # [ 217.824685] gitaly[1381]: time="2026-08-11T09:42:56.767Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR388YBJGAV8HWT7YS8XG39 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T09:43:26.465" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:56.766" grpc.time_ms=0.652 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1942gitlab # [ 217.845145] nix-daemon[3434]: accepted connection from pid 3629, user nixbot1943gitlab # [ 217.846863] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:42:56 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/f40b211475671ebb570f445080aee2bc707d4975/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 701944gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f40b211475671ebb570f445080aee2bc707d4975/statuses, in 0.13 seconds)1945gitlab # [ 217.865276] gitaly[1381]: time="2026-08-11T09:42:56.816Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KZR388XSEH43G7KSBF1ZJJSA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T09:43:06.078" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T09:42:56.808" grpc.time_ms=7.683 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1946gitlab # [ 217.901286] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:56.851Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"86297ac59ed6951bec3166f9","created_at":"2026-08-11T09:42:56.845Z","trace_propagation_headers":{"sentry-trace":"8a2cbaf3634e451f9564f4513a33b1db-6fb828154cdf40dc","baggage":"sentry-trace_id=8a2cbaf3634e451f9564f4513a33b1db,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR388XSEH43G7KSBF1ZJJSA","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:56.849Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m5o5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-86297ac59ed6951bec3166f9: start","job_status":"start","queue_duration_s":0.002271,"scheduling_latency_s":0.002391}1947gitlab # [ 217.913247] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:42:56 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/075c9ab1f688abeabd7100784bc099321ae5e1e8 HTTP/1.1" 201 665 "" "python-httpx/0.28.1" 1651948gitlab # [ 217.914978] nixbot[3159]: {"ts": "2026-08-11T09:42:56.864Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/075c9ab1f688abeabd7100784bc099321ae5e1e8 \"HTTP/1.1 201 Created\""}1949gitlab # [ 217.943404] gitaly[1381]: time="2026-08-11T09:42:56.893Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR388XSEH43G7KSBF1ZJJSA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T09:43:26.591" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:56.892" grpc.time_ms=1.175 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1950gitlab # [ 217.981265] gitaly[1381]: time="2026-08-11T09:42:56.932Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR388XSEH43G7KSBF1ZJJSA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T09:43:26.631" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:56.931" grpc.time_ms=0.926 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1951gitlab # [ 218.002941] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:42:56.953Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"86297ac59ed6951bec3166f9","created_at":"2026-08-11T09:42:56.845Z","trace_propagation_headers":{"sentry-trace":"8a2cbaf3634e451f9564f4513a33b1db-6fb828154cdf40dc","baggage":"sentry-trace_id=8a2cbaf3634e451f9564f4513a33b1db,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR388XSEH43G7KSBF1ZJJSA","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-11T09:42:56.849Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m5o5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-86297ac59ed6951bec3166f9: done: 0.102507 sec","job_status":"done","queue_duration_s":0.002271,"scheduling_latency_s":0.002391,"gitaly_calls":2,"gitaly_duration_s":0.008569,"redis_calls":19,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.004704,"redis_read_bytes":42,"redis_write_bytes":1891,"redis_cache_calls":8,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.00077,"redis_cache_read_bytes":16,"redis_cache_write_bytes":735,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002134,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.000238,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001562,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":20,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":20,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":9,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.06529,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.063678485,"duration_s":0.102507,"completed_at":"2026-08-11T09:42:56.953Z","load_balancing_strategy":"primary","db_duration_s":0.022077,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1952gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f40b211475671ebb570f445080aee2bc707d4975/statuses1953gitlab # [ 218.979747] gitaly[1381]: time="2026-08-11T09:42:57.930Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR38A1S784N7HG2SSQ2NVVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T09:43:27.027" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:57.928" grpc.time_ms=1.268 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1954gitlab # [ 219.009886] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:42:57 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/f40b211475671ebb570f445080aee2bc707d4975/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 1101955gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f40b211475671ebb570f445080aee2bc707d4975/statuses, in 0.18 seconds)1956gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f40b211475671ebb570f445080aee2bc707d4975/statuses1957gitlab # [ 220.154476] gitaly[1381]: time="2026-08-11T09:42:59.105Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR38B6PZE6HYDFTJ12XTQZR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T09:43:29.102" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:42:59.103" grpc.time_ms=1.299 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1958gitlab # [ 220.219258] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:42:59 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/f40b211475671ebb570f445080aee2bc707d4975/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 1381959gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f40b211475671ebb570f445080aee2bc707d4975/statuses, in 0.19 seconds)1960gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f40b211475671ebb570f445080aee2bc707d4975/statuses1961gitlab # [ 221.352253] gitaly[1381]: time="2026-08-11T09:43:00.302Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR38CC0389J6EM39JVHHDK4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T09:43:30.300" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:43:00.301" grpc.time_ms=1.347 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1962gitlab # [ 221.440354] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:43:00 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/f40b211475671ebb570f445080aee2bc707d4975/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 1651963gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f40b211475671ebb570f445080aee2bc707d4975/statuses, in 0.22 seconds)1964gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f40b211475671ebb570f445080aee2bc707d4975/statuses1965gitlab # [ 222.453351] nix-daemon[3434]: accepted connection from pid 3658, user nixbot1966gitlab # [ 222.519880] gitaly[1381]: time="2026-08-11T09:43:01.470Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR38DFTRP27PR0117JWZKZQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T09:43:31.467" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:43:01.468" grpc.time_ms=1.156 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1967gitlab # [ 222.528785] gitaly[1381]: time="2026-08-11T09:43:01.475Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR38DHT48VFPJE3WCK5PG00 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T09:43:31.174" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:43:01.475" grpc.time_ms=0.73 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1968gitlab # [ 222.543789] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:43:01 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/f40b211475671ebb570f445080aee2bc707d4975/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 591969gitlab # [ 222.569205] gitaly[1381]: time="2026-08-11T09:43:01.520Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR38DFTRP27PR0117JWZKZQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T09:43:11.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T09:43:01.511" grpc.time_ms=8.951 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1970gitlab # [ 222.597765] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:01.548Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"235fc0c5efde9c65b0563012","created_at":"2026-08-11T09:43:01.542Z","trace_propagation_headers":{"sentry-trace":"cb764f87ff2746079c49efa8dde2a89f-458a8d410a7443d5","baggage":"sentry-trace_id=cb764f87ff2746079c49efa8dde2a89f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR38DFTRP27PR0117JWZKZQ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-11T09:43:01.545Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m5o5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-235fc0c5efde9c65b0563012: start","job_status":"start","queue_duration_s":0.002284,"scheduling_latency_s":0.002351}1971gitlab # [ 222.609086] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:43:01 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f40b211475671ebb570f445080aee2bc707d4975 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 1881972gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f40b211475671ebb570f445080aee2bc707d4975/statuses, in 0.18 seconds)1973gitlab # [ 222.629871] nixbot[3159]: {"ts": "2026-08-11T09:43:01.580Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f40b211475671ebb570f445080aee2bc707d4975 \"HTTP/1.1 201 Created\""}1974gitlab # [ 222.684839] gitaly[1381]: time="2026-08-11T09:43:01.636Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR38DPKBZ0BFW53MSNDT72N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T09:43:31.634" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:43:01.635" grpc.time_ms=0.681 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1975gitlab # [ 222.725145] gitaly[1381]: time="2026-08-11T09:43:01.676Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR38DPKBZ0BFW53MSNDT72N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T09:43:11.168" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T09:43:01.668" grpc.time_ms=7.816 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1976gitlab # [ 222.726977] gitaly[1381]: time="2026-08-11T09:43:01.678Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR38DFTRP27PR0117JWZKZQ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3899 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T09:43:01.677" grpc.time_ms=0.523 pid=1381 span.kind=server system=grpc1977gitlab # [ 222.787725] nixbot[3159]: {"ts": "2026-08-11T09:43:01.739Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f40b211475671ebb570f445080aee2bc707d4975 \"HTTP/1.1 201 Created\""}1978gitlab # [ 222.789300] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:43:01 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f40b211475671ebb570f445080aee2bc707d4975 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1531979gitlab # [ 222.791268] gitaly[1381]: time="2026-08-11T09:43:01.742Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR38DFTRP27PR0117JWZKZQ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T09:43:01.742" grpc.time_ms=0.585 pid=1381 span.kind=server system=grpc1980gitlab # [ 222.836666] gitaly[1381]: time="2026-08-11T09:43:01.788Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR38DFTRP27PR0117JWZKZQ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3899 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T09:43:01.787" grpc.time_ms=0.86 pid=1381 span.kind=server system=grpc1981gitlab # [ 222.863622] gitaly[1381]: time="2026-08-11T09:43:01.815Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR38DFTRP27PR0117JWZKZQ diskcache=8a811a04-5ebe-4e06-9e7e-1ad418f1f968 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T09:43:31.331" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-11T09:43:01.632" pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1982gitlab # [ 222.879222] gitaly[1381]: time="2026-08-11T09:43:01.830Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=154 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7231 command.oublock=0 command.real_time_ms=174 command.spawn_token_fork_ms=0 command.system_time_ms=114 command.user_time_ms=40 component=gitaly.UnaryServerInterceptor correlation_id=01KZR38DFTRP27PR0117JWZKZQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T09:43:31.331" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T09:43:01.632" grpc.time_ms=182.772 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1983gitlab # [ 222.927070] gitaly[1381]: time="2026-08-11T09:43:01.878Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR38DFTRP27PR0117JWZKZQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T09:43:31.576" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:43:01.876" grpc.time_ms=1.448 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1984gitlab # [ 222.975559] gitaly[1381]: time="2026-08-11T09:43:01.926Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR38DFTRP27PR0117JWZKZQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T09:43:31.625" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:43:01.925" grpc.time_ms=1.054 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1985gitlab # [ 223.026746] gitaly[1381]: time="2026-08-11T09:43:01.978Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR38DFTRP27PR0117JWZKZQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T09:43:31.675" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:43:01.976" grpc.time_ms=1.465 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1986gitlab # [ 223.070229] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:02.021Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"696df177fbed212a20fa61d6","created_at":"2026-08-11T09:43:02.016Z","trace_propagation_headers":{"sentry-trace":"cb764f87ff2746079c49efa8dde2a89f-e8562091840b4485","baggage":"sentry-trace_id=cb764f87ff2746079c49efa8dde2a89f,sentry-release=Unknown"},"correlation_id":"01KZR38DFTRP27PR0117JWZKZQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"235fc0c5efde9c65b0563012","job_size_bytes":3,"pid":2141,"job_status":"deduplicated","message":"PipelineProcessWorker JID-696df177fbed212a20fa61d6: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}1987gitlab # [ 223.097267] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:02.048Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"235fc0c5efde9c65b0563012","created_at":"2026-08-11T09:43:01.542Z","trace_propagation_headers":{"sentry-trace":"cb764f87ff2746079c49efa8dde2a89f-458a8d410a7443d5","baggage":"sentry-trace_id=cb764f87ff2746079c49efa8dde2a89f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR38DFTRP27PR0117JWZKZQ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-11T09:43:01.545Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2141,"job_status":"rescheduled","message":"PipelineProcessWorker JID-235fc0c5efde9c65b0563012: rescheduled"}1988gitlab # [ 223.133858] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:02.084Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"235fc0c5efde9c65b0563012","created_at":"2026-08-11T09:43:01.542Z","trace_propagation_headers":{"sentry-trace":"cb764f87ff2746079c49efa8dde2a89f-458a8d410a7443d5","baggage":"sentry-trace_id=cb764f87ff2746079c49efa8dde2a89f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR38DFTRP27PR0117JWZKZQ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-11T09:43:01.545Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m5o5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-235fc0c5efde9c65b0563012: done: 0.53641 sec","job_status":"done","queue_duration_s":0.002284,"scheduling_latency_s":0.002351,"gitaly_calls":4,"gitaly_duration_s":0.239891,"redis_calls":94,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.073655,"redis_read_bytes":263,"redis_write_bytes":23469,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001187,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":21,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.004626,"redis_cache_read_bytes":39,"redis_cache_write_bytes":1840,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001549,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":712,"redis_queues_calls":25,"redis_queues_duration_s":0.005127,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14465,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.055082,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000708,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001167,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.003022,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":38,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":38,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.043,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":23,"db_ci_count":15,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.008,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.012,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.018,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.192462,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.429666899,"duration_s":0.53641,"completed_at":"2026-08-11T09:43:02.084Z","load_balancing_strategy":"primary","db_duration_s":0.04671,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1989gitlab # [ 223.221333] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:02.172Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"55626b6a728ed119dea8fa2c","created_at":"2026-08-11T09:43:01.624Z","trace_propagation_headers":{"sentry-trace":"cb764f87ff2746079c49efa8dde2a89f-e8562091840b4485","baggage":"sentry-trace_id=cb764f87ff2746079c49efa8dde2a89f,sentry-release=Unknown"},"correlation_id":"01KZR38DFTRP27PR0117JWZKZQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-11T09:43:01.626Z","job_size_bytes":23,"pid":2141,"sidekiq_tid":"m5o5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-55626b6a728ed119dea8fa2c: start","job_status":"start","queue_duration_s":0.545214,"scheduling_latency_s":0.54529}1990gitlab # [ 223.308145] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:02.258Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"55626b6a728ed119dea8fa2c","created_at":"2026-08-11T09:43:01.624Z","trace_propagation_headers":{"sentry-trace":"cb764f87ff2746079c49efa8dde2a89f-e8562091840b4485","baggage":"sentry-trace_id=cb764f87ff2746079c49efa8dde2a89f,sentry-release=Unknown"},"correlation_id":"01KZR38DFTRP27PR0117JWZKZQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-11T09:43:01.626Z","job_size_bytes":23,"pid":2141,"sidekiq_tid":"m5o5","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-55626b6a728ed119dea8fa2c: done: 0.0869 sec","job_status":"done","queue_duration_s":0.545214,"scheduling_latency_s":0.54529,"redis_calls":7,"redis_duration_s":0.011278,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.008884,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002394,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051438,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0869,"completed_at":"2026-08-11T09:43:02.258Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015025,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1991gitlab # [ 223.313131] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:02.263Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"f40c73ede5fc1544f62dcc49","created_at":"2026-08-11T09:42:41.505Z","trace_propagation_headers":{"sentry-trace":"1755637edba541f8bb96f26e9744fbeb-dfb961af4db34ecf","baggage":"sentry-trace_id=1755637edba541f8bb96f26e9744fbeb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR37SRX80K1QBQYGDESB5PR","meta.caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"system_access","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:1cbc359d3293aa4df3cab924cfac11eb40ad08ac2e5612c5090619896971fc8b","size_limiter":"validated","enqueued_at":"2026-08-11T09:43:02.197Z","retry_count":0,"job_size_bytes":451,"pid":2141,"sidekiq_tid":"m5o5","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-f40c73ede5fc1544f62dcc49: start","job_status":"start","queue_duration_s":0.06614,"scheduling_latency_s":0.066217}1992gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f40b211475671ebb570f445080aee2bc707d4975/statuses1993gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f40b211475671ebb570f445080aee2bc707d4975/statuses, in 0.19 seconds)1994gitlab # [ 223.378959] sidekiq-cluster[2141]: {"severity":"WARN","time":"2026-08-11T09:43:02.329Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"f40c73ede5fc1544f62dcc49","created_at":"2026-08-11T09:42:41.505Z","trace_propagation_headers":{"sentry-trace":"1755637edba541f8bb96f26e9744fbeb-dfb961af4db34ecf","baggage":"sentry-trace_id=1755637edba541f8bb96f26e9744fbeb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR37SRX80K1QBQYGDESB5PR","meta.caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"system_access","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:1cbc359d3293aa4df3cab924cfac11eb40ad08ac2e5612c5090619896971fc8b","size_limiter":"validated","enqueued_at":"2026-08-11T09:43:02.197Z","retry_count":0,"job_size_bytes":451,"pid":2141,"sidekiq_tid":"m5o5","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-f40c73ede5fc1544f62dcc49: fail: 0.065523 sec","job_status":"fail","queue_duration_s":0.06614,"scheduling_latency_s":0.066217,"redis_calls":7,"redis_duration_s":0.004173,"redis_read_bytes":5,"redis_write_bytes":786,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003116,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001057,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":250,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039943,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.065523,"completed_at":"2026-08-11T09:43:02.328Z","load_balancing_strategy":"primary_no_wal","exception.class":"ArgumentError","exception.message":":arguments expected to be an Array of individual string args","exception.backtrace":["/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/network/delivery_methods/sendmail.rb:53:in `initialize'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `new'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `delivery_method'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:66:in `wrap_delivery_behavior'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:80:in `wrap_delivery_behavior!'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:876:in `mail'","app/mailers/application_mailer.rb:85:in `block in mail_with_locale'","lib/gitlab/i18n.rb:116:in `with_locale'","app/mailers/application_mailer.rb:84:in `mail_with_locale'","app/mailers/notify.rb:293:in `email_with_layout'","app/mailers/emails/profile.rb:99:in `access_token_created_email'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:215:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:261:in `block in process_action'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","lib/gitlab/i18n.rb:116:in `with_locale'","lib/gitlab/i18n.rb:126:in `with_default_locale'","app/mailers/application_mailer.rb:60:in `render_with_default_locale'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:260:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:152:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:29:in `block in process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:21:in `handle_exceptions'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:28:in `process'","/nix/store/abbaw4w9gll6p923md75p3h3rrmhrdqn-ruby3.3-actionview-7.2.3/lib/ruby/gems/3.3.0/gems/actionview-7.2.3/lib/action_view/rendering.rb:40:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:652:in `block in process'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:651:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:136:in `block in processed_mailer'","\u003cinternal:kernel\u003e:90:in `tap'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:135:in `processed_mailer'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:124:in `deliver_now'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/mail_delivery_job.rb:28:in `perform'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:68:in `block in _perform_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/railtie.rb:32:in `block (2 levels) in insert_into_active_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/bqz31s23z0jk4464lbybyz83ikl0gmyd-ruby3.3-i18n-1.14.7/lib/ruby/gems/3.3.0/gems/i18n-1.14.7/lib/i18n.rb:353:in `with_locale'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/translation.rb:9:in `block (2 levels) in \u003cmodule:Translation\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/core_ext/time/zones.rb:65:in `use_zone'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/timezones.rb:9:in `block (2 levels) in \u003cmodule:Timezones\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:67:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:32:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:51:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `block in perform_now'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:13:in `block in instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:40:in `block in instrument'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:39:in `instrument'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:11:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `block in perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:41:in `tag_logger'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `perform_now'","/nix/store/wp2rnxa243q2gn2f8h04d48hnvfr0387-ruby3.3-sentry-rails-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-rails-5.23.0/lib/sentry/rails/active_job.rb:8:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:29:in `block in execute'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:79:in `block (4 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:87:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:78:in `block (3 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:27:in `execute'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:13:in `perform'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:220:in `execute_job'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:185:in `block (4 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/current_organization/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/identity/restore.rb:12:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/resource_usage_limit/middleware.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/resource_usage_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/database/load_balancing/sidekiq_server_middleware.rb:35:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/skip_jobs.rb:51:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/throttling/middleware.rb:18:in `perform'","lib/gitlab/sidekiq_middleware/throttling/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/pause_control/strategies/base.rb:31:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/strategy_handler.rb:22:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/duplicate_jobs/strategies/until_executing.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/duplicate_job.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/concurrency_limit/middleware.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/concurrency_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/click_house/migration_support/sidekiq_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/worker_context.rb:9:in `wrap_in_optional_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:19:in `block in call'","lib/gitlab/application_context.rb:185:in `block in use'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","lib/gitlab/application_context.rb:185:in `use'","lib/gitlab/application_context.rb:105:in `with_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:17:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_status/server_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_versioning/middleware.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `block in call'","lib/gitlab/database/query_analyzer.rb:94:in `within'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/admin_mode/server.rb:14:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/set_ip_address.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/instrumentation_logger.rb:10:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/batch_loader.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/extra_done_log_metadata.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/server_metrics.rb:112:in `block in call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `block in instrument'","lib/gitlab/metrics/background_transaction.rb:33:in `run'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `instrument'","lib/gitlab/sidekiq_middleware/server_metrics.rb:111:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:8:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:66:in `enabling_request_store'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:59:in `ensure_request_store'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:22:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/user_experience_sli/server.rb:16:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:16:in `block in call'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:15:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/monitor.rb:10:in `block in call'","lib/gitlab/sidekiq_daemon/monitor.rb:46:in `within_job'","lib/gitlab/sidekiq_middleware/monitor.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:10:in `block in call'","lib/gitlab/sidekiq_sharding/validator.rb:42:in `enabled'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/size_limiter/server.rb:13:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/sidekiq_instrumentation.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/85h4805ad7n5qn7wq2m6icypga7rnk80-ruby3.3-sentry-sidekiq-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-sidekiq-5.23.0/lib/sentry/sidekiq/sentry_context_middleware.rb:54:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job/interrupt_handler.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:26:in `track'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:134:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:184:in `block (3 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:145:in `block (6 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:118:in `local'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:144:in `block (5 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:27:in `block in call'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:91:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:26:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:139:in `block (4 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:281:in `stats'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:134:in `block (3 levels) in dispatch'","lib/gitlab/sidekiq_logging/structured_logger.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:133:in `block (2 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:85:in `global'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:132:in `block in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_logger.rb:40:in `prepare'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:131:in `dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:183:in `block (2 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `block in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:86:in `process_one'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:76:in `run'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:10:in `watchdog'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:19:in `block in safe_thread'"],"db_duration_s":0.008196,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1995gitlab # [ 223.962842] gitaly[1381]: time="2026-08-11T09:43:02.676Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR38DFTRP27PR0117JWZKZQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T09:43:32.374" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:43:02.674" grpc.time_ms=2.181 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1996gitlab # [ 223.964459] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:43:02 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/f40b211475671ebb570f445080aee2bc707d4975/statuses HTTP/1.1" 200 1307 "" "curl/8.20.0" 751997gitlab # [ 223.965619] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:02.334Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"e409dcfe1bf0b2350213a270","created_at":"2026-08-11T09:43:01.837Z","trace_propagation_headers":{"sentry-trace":"cb764f87ff2746079c49efa8dde2a89f-e8562091840b4485","baggage":"sentry-trace_id=cb764f87ff2746079c49efa8dde2a89f,sentry-release=Unknown"},"correlation_id":"01KZR38DFTRP27PR0117JWZKZQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-11T09:43:01.840Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m9b1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-e409dcfe1bf0b2350213a270: start","job_status":"start","queue_duration_s":0.493835,"scheduling_latency_s":0.493906}1998gitlab # [ 223.991184] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:02.378Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"e409dcfe1bf0b2350213a270","created_at":"2026-08-11T09:43:01.837Z","trace_propagation_headers":{"sentry-trace":"cb764f87ff2746079c49efa8dde2a89f-e8562091840b4485","baggage":"sentry-trace_id=cb764f87ff2746079c49efa8dde2a89f,sentry-release=Unknown"},"correlation_id":"01KZR38DFTRP27PR0117JWZKZQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-11T09:43:01.840Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m9b1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-e409dcfe1bf0b2350213a270: done: 0.044072 sec","job_status":"done","queue_duration_s":0.493835,"scheduling_latency_s":0.493906,"redis_calls":7,"redis_duration_s":0.003548,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002529,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001019,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026821,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.044072,"completed_at":"2026-08-11T09:43:02.378Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004843,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1999gitlab # [ 224.103042] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:02.380Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"c94774d39b396bd59e288e99","created_at":"2026-08-11T09:43:01.847Z","trace_propagation_headers":{"sentry-trace":"cb764f87ff2746079c49efa8dde2a89f-e8562091840b4485","baggage":"sentry-trace_id=cb764f87ff2746079c49efa8dde2a89f,sentry-release=Unknown"},"correlation_id":"01KZR38DFTRP27PR0117JWZKZQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-11T09:43:01.851Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m9b1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-c94774d39b396bd59e288e99: start","job_status":"start","queue_duration_s":0.529124,"scheduling_latency_s":0.529183}2000gitlab # [ 224.104303] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:02.409Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"c94774d39b396bd59e288e99","created_at":"2026-08-11T09:43:01.847Z","trace_propagation_headers":{"sentry-trace":"cb764f87ff2746079c49efa8dde2a89f-e8562091840b4485","baggage":"sentry-trace_id=cb764f87ff2746079c49efa8dde2a89f,sentry-release=Unknown"},"correlation_id":"01KZR38DFTRP27PR0117JWZKZQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-11T09:43:01.851Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m9b1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-c94774d39b396bd59e288e99: done: 0.029243 sec","job_status":"done","queue_duration_s":0.529124,"scheduling_latency_s":0.529183,"redis_calls":7,"redis_duration_s":0.003558,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002247,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001311,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01524,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029243,"completed_at":"2026-08-11T09:43:02.409Z","load_balancing_strategy":"primary","db_duration_s":0.007558,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2001gitlab # [ 224.148270] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:02.411Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"7569bc93bd48c99c1d7d2215","created_at":"2026-08-11T09:43:01.859Z","trace_propagation_headers":{"sentry-trace":"cb764f87ff2746079c49efa8dde2a89f-e8562091840b4485","baggage":"sentry-trace_id=cb764f87ff2746079c49efa8dde2a89f,sentry-release=Unknown"},"correlation_id":"01KZR38DFTRP27PR0117JWZKZQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-11T09:43:01.861Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m9b1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-7569bc93bd48c99c1d7d2215: start","job_status":"start","queue_duration_s":0.550586,"scheduling_latency_s":0.550609}2002gitlab # [ 224.172771] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:02.437Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"7569bc93bd48c99c1d7d2215","created_at":"2026-08-11T09:43:01.859Z","trace_propagation_headers":{"sentry-trace":"cb764f87ff2746079c49efa8dde2a89f-e8562091840b4485","baggage":"sentry-trace_id=cb764f87ff2746079c49efa8dde2a89f,sentry-release=Unknown"},"correlation_id":"01KZR38DFTRP27PR0117JWZKZQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-11T09:43:01.861Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m9b1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-7569bc93bd48c99c1d7d2215: done: 0.026227 sec","job_status":"done","queue_duration_s":0.550586,"scheduling_latency_s":0.550609,"redis_calls":10,"redis_duration_s":0.0036249999999999998,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001949,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001022,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000654,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015726,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026227,"completed_at":"2026-08-11T09:43:02.437Z","load_balancing_strategy":"primary","db_duration_s":0.004565,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2003gitlab # [ 224.245086] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:02.439Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"063cdfed827f328773841017","created_at":"2026-08-11T09:43:01.861Z","trace_propagation_headers":{"sentry-trace":"cb764f87ff2746079c49efa8dde2a89f-e8562091840b4485","baggage":"sentry-trace_id=cb764f87ff2746079c49efa8dde2a89f,sentry-release=Unknown"},"correlation_id":"01KZR38DFTRP27PR0117JWZKZQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-11T09:43:01.863Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m9b1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-063cdfed827f328773841017: start","job_status":"start","queue_duration_s":0.576582,"scheduling_latency_s":0.576607}2004gitlab # [ 224.265242] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:02.461Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"063cdfed827f328773841017","created_at":"2026-08-11T09:43:01.861Z","trace_propagation_headers":{"sentry-trace":"cb764f87ff2746079c49efa8dde2a89f-e8562091840b4485","baggage":"sentry-trace_id=cb764f87ff2746079c49efa8dde2a89f,sentry-release=Unknown"},"correlation_id":"01KZR38DFTRP27PR0117JWZKZQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-11T09:43:01.863Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m9b1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-063cdfed827f328773841017: done: 0.021783 sec","job_status":"done","queue_duration_s":0.576582,"scheduling_latency_s":0.576607,"redis_calls":7,"redis_duration_s":0.002463,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001772,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000691,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011842,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021783,"completed_at":"2026-08-11T09:43:02.461Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00468,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2005gitlab # [ 224.386059] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:02.463Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"8110761b3d973fffe686c10e","created_at":"2026-08-11T09:43:01.863Z","trace_propagation_headers":{"sentry-trace":"cb764f87ff2746079c49efa8dde2a89f-e8562091840b4485","baggage":"sentry-trace_id=cb764f87ff2746079c49efa8dde2a89f,sentry-release=Unknown"},"correlation_id":"01KZR38DFTRP27PR0117JWZKZQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-11T09:43:01.865Z","job_size_bytes":19,"pid":2141,"sidekiq_tid":"m9b1","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-8110761b3d973fffe686c10e: start","job_status":"start","queue_duration_s":0.59753,"scheduling_latency_s":0.597553}2006gitlab # [ 224.387304] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:02.485Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"8110761b3d973fffe686c10e","created_at":"2026-08-11T09:43:01.863Z","trace_propagation_headers":{"sentry-trace":"cb764f87ff2746079c49efa8dde2a89f-e8562091840b4485","baggage":"sentry-trace_id=cb764f87ff2746079c49efa8dde2a89f,sentry-release=Unknown"},"correlation_id":"01KZR38DFTRP27PR0117JWZKZQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-11T09:43:01.865Z","job_size_bytes":19,"pid":2141,"sidekiq_tid":"m9b1","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-8110761b3d973fffe686c10e: done: 0.022179 sec","job_status":"done","queue_duration_s":0.59753,"scheduling_latency_s":0.597553,"redis_calls":8,"redis_duration_s":0.0029760000000000003,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00223,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000746,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013255,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022179,"completed_at":"2026-08-11T09:43:02.485Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003368,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2007gitlab # [ 224.423226] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:02.487Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f989a54de46323aa5f9f1bac","created_at":"2026-08-11T09:43:01.866Z","trace_propagation_headers":{"sentry-trace":"cb764f87ff2746079c49efa8dde2a89f-e8562091840b4485","baggage":"sentry-trace_id=cb764f87ff2746079c49efa8dde2a89f,sentry-release=Unknown"},"correlation_id":"01KZR38DFTRP27PR0117JWZKZQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-11T09:43:01.867Z","job_size_bytes":66,"pid":2141,"sidekiq_tid":"m9b1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f989a54de46323aa5f9f1bac: start","job_status":"start","queue_duration_s":0.619183,"scheduling_latency_s":0.619206}2008gitlab # [ 224.451067] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:02.505Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f989a54de46323aa5f9f1bac","created_at":"2026-08-11T09:43:01.866Z","trace_propagation_headers":{"sentry-trace":"cb764f87ff2746079c49efa8dde2a89f-e8562091840b4485","baggage":"sentry-trace_id=cb764f87ff2746079c49efa8dde2a89f,sentry-release=Unknown"},"correlation_id":"01KZR38DFTRP27PR0117JWZKZQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-11T09:43:01.867Z","job_size_bytes":66,"pid":2141,"sidekiq_tid":"m9b1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f989a54de46323aa5f9f1bac: done: 0.018231 sec","job_status":"done","queue_duration_s":0.619183,"scheduling_latency_s":0.619206,"redis_calls":7,"redis_duration_s":0.002811,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002089,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000722,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010749,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018231,"completed_at":"2026-08-11T09:43:02.505Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001853,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2009gitlab # [ 224.528100] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:02.507Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"0e2af195825bca69edeae3f2","created_at":"2026-08-11T09:43:01.868Z","trace_propagation_headers":{"sentry-trace":"cb764f87ff2746079c49efa8dde2a89f-e8562091840b4485","baggage":"sentry-trace_id=cb764f87ff2746079c49efa8dde2a89f,sentry-release=Unknown"},"correlation_id":"01KZR38DFTRP27PR0117JWZKZQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-11T09:43:01.870Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m9b1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-0e2af195825bca69edeae3f2: start","job_status":"start","queue_duration_s":0.636863,"scheduling_latency_s":0.636886}2010gitlab # [ 224.542212] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:02.535Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"0e2af195825bca69edeae3f2","created_at":"2026-08-11T09:43:01.868Z","trace_propagation_headers":{"sentry-trace":"cb764f87ff2746079c49efa8dde2a89f-e8562091840b4485","baggage":"sentry-trace_id=cb764f87ff2746079c49efa8dde2a89f,sentry-release=Unknown"},"correlation_id":"01KZR38DFTRP27PR0117JWZKZQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-11T09:43:01.870Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m9b1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-0e2af195825bca69edeae3f2: done: 0.028147 sec","job_status":"done","queue_duration_s":0.636863,"scheduling_latency_s":0.636886,"redis_calls":7,"redis_duration_s":0.00259,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001864,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000726,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017738,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028147,"completed_at":"2026-08-11T09:43:02.535Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005072,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2011gitlab # [ 224.668913] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:02.537Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"d154fbf0368b7796f591ad52","created_at":"2026-08-11T09:43:01.936Z","trace_propagation_headers":{"sentry-trace":"cb764f87ff2746079c49efa8dde2a89f-e8562091840b4485","baggage":"sentry-trace_id=cb764f87ff2746079c49efa8dde2a89f,sentry-release=Unknown"},"correlation_id":"01KZR38DFTRP27PR0117JWZKZQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-08-11T09:43:01.937Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m9b1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-d154fbf0368b7796f591ad52: start","job_status":"start","queue_duration_s":0.599197,"scheduling_latency_s":0.599221}2012gitlab # [ 224.670163] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:02.558Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"d154fbf0368b7796f591ad52","created_at":"2026-08-11T09:43:01.936Z","trace_propagation_headers":{"sentry-trace":"cb764f87ff2746079c49efa8dde2a89f-e8562091840b4485","baggage":"sentry-trace_id=cb764f87ff2746079c49efa8dde2a89f,sentry-release=Unknown"},"correlation_id":"01KZR38DFTRP27PR0117JWZKZQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-08-11T09:43:01.937Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m9b1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-d154fbf0368b7796f591ad52: done: 0.021381 sec","job_status":"done","queue_duration_s":0.599197,"scheduling_latency_s":0.599221,"redis_calls":7,"redis_duration_s":0.0024259999999999998,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001664,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000762,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011636,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021381,"completed_at":"2026-08-11T09:43:02.558Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004528,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2013gitlab # [ 224.700342] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:02.560Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"a8cb697f0ae4bd6f88e02003","created_at":"2026-08-11T09:43:01.938Z","trace_propagation_headers":{"sentry-trace":"cb764f87ff2746079c49efa8dde2a89f-e8562091840b4485","baggage":"sentry-trace_id=cb764f87ff2746079c49efa8dde2a89f,sentry-release=Unknown"},"correlation_id":"01KZR38DFTRP27PR0117JWZKZQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-11T09:43:01.939Z","job_size_bytes":6,"pid":2141,"sidekiq_tid":"m9b1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-a8cb697f0ae4bd6f88e02003: start","job_status":"start","queue_duration_s":0.620207,"scheduling_latency_s":0.62023}2014gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f40b211475671ebb570f445080aee2bc707d4975/statuses2015gitlab # [ 224.725210] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:02.574Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"a8cb697f0ae4bd6f88e02003","created_at":"2026-08-11T09:43:01.938Z","trace_propagation_headers":{"sentry-trace":"cb764f87ff2746079c49efa8dde2a89f-e8562091840b4485","baggage":"sentry-trace_id=cb764f87ff2746079c49efa8dde2a89f,sentry-release=Unknown"},"correlation_id":"01KZR38DFTRP27PR0117JWZKZQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-11T09:43:01.939Z","job_size_bytes":6,"pid":2141,"sidekiq_tid":"m9b1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-a8cb697f0ae4bd6f88e02003: done: 0.014664 sec","job_status":"done","queue_duration_s":0.620207,"scheduling_latency_s":0.62023,"redis_calls":7,"redis_duration_s":0.0025529999999999997,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001811,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000742,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00859,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014664,"completed_at":"2026-08-11T09:43:02.574Z","load_balancing_strategy":"primary","db_duration_s":0.000627,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2016gitlab # [ 224.810987] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:02.576Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"f48227810e7ed3cb968861f3","created_at":"2026-08-11T09:43:01.940Z","trace_propagation_headers":{"sentry-trace":"cb764f87ff2746079c49efa8dde2a89f-e8562091840b4485","baggage":"sentry-trace_id=cb764f87ff2746079c49efa8dde2a89f,sentry-release=Unknown"},"correlation_id":"01KZR38DFTRP27PR0117JWZKZQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-08-11T09:43:01.944Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m9b1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-f48227810e7ed3cb968861f3: start","job_status":"start","queue_duration_s":0.631585,"scheduling_latency_s":0.631606}2017gitlab # [ 224.814120] gitaly[1381]: time="2026-08-11T09:43:02.722Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR38DFTRP27PR0117JWZKZQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T09:43:32.420" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:43:02.721" grpc.time_ms=0.783 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2018gitlab # [ 224.832960] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:02.605Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"f48227810e7ed3cb968861f3","created_at":"2026-08-11T09:43:01.940Z","trace_propagation_headers":{"sentry-trace":"cb764f87ff2746079c49efa8dde2a89f-e8562091840b4485","baggage":"sentry-trace_id=cb764f87ff2746079c49efa8dde2a89f,sentry-release=Unknown"},"correlation_id":"01KZR38DFTRP27PR0117JWZKZQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-08-11T09:43:01.944Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m9b1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-f48227810e7ed3cb968861f3: done: 0.029077 sec","job_status":"done","queue_duration_s":0.631585,"scheduling_latency_s":0.631606,"redis_calls":10,"redis_duration_s":0.003683,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000815,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002199,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000669,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016514,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000456762,"duration_s":0.029077,"completed_at":"2026-08-11T09:43:02.605Z","load_balancing_strategy":"primary","db_duration_s":0.005523,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2019gitlab # [ 224.951284] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:02.607Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"ddc207d0514bd7b74cb2a965","created_at":"2026-08-11T09:43:02.048Z","trace_propagation_headers":{"sentry-trace":"cb764f87ff2746079c49efa8dde2a89f-e8562091840b4485","baggage":"sentry-trace_id=cb764f87ff2746079c49efa8dde2a89f,sentry-release=Unknown"},"correlation_id":"01KZR38DFTRP27PR0117JWZKZQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-11T09:43:02.074Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m9b1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-ddc207d0514bd7b74cb2a965: start","job_status":"start","queue_duration_s":0.532673,"scheduling_latency_s":0.532693}2020gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f40b211475671ebb570f445080aee2bc707d4975/statuses, in 0.19 seconds)2021gitlab # [ 224.952716] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:02.771Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"ddc207d0514bd7b74cb2a965","created_at":"2026-08-11T09:43:02.048Z","trace_propagation_headers":{"sentry-trace":"cb764f87ff2746079c49efa8dde2a89f-e8562091840b4485","baggage":"sentry-trace_id=cb764f87ff2746079c49efa8dde2a89f,sentry-release=Unknown"},"correlation_id":"01KZR38DFTRP27PR0117JWZKZQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-11T09:43:02.074Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m9b1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-ddc207d0514bd7b74cb2a965: done: 0.164332 sec","job_status":"done","queue_duration_s":0.532673,"scheduling_latency_s":0.532693,"gitaly_calls":3,"gitaly_duration_s":0.027048,"redis_calls":44,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.013989999999999999,"redis_read_bytes":98,"redis_write_bytes":6013,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001537,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":20,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.002208,"redis_cache_read_bytes":38,"redis_cache_write_bytes":1784,"redis_queues_calls":2,"redis_queues_duration_s":0.001083,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1132,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.004983,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000414,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000544,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001684,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.034,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":20,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.090883,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.138087382,"duration_s":0.164332,"completed_at":"2026-08-11T09:43:02.771Z","load_balancing_strategy":"primary","db_duration_s":0.037765,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2022gitlab # [ 225.005465] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:02.773Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"b3beda5f5c526f5055424013","created_at":"2026-08-11T09:43:02.661Z","trace_propagation_headers":{"sentry-trace":"cb764f87ff2746079c49efa8dde2a89f-e79cb8155e154e09","baggage":"sentry-trace_id=cb764f87ff2746079c49efa8dde2a89f,sentry-release=Unknown"},"correlation_id":"01KZR38DFTRP27PR0117JWZKZQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-11T09:43:02.664Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m9b1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-b3beda5f5c526f5055424013: start","job_status":"start","queue_duration_s":0.1087,"scheduling_latency_s":0.108732}2023gitlab # [ 225.093140] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:02.801Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"b3beda5f5c526f5055424013","created_at":"2026-08-11T09:43:02.661Z","trace_propagation_headers":{"sentry-trace":"cb764f87ff2746079c49efa8dde2a89f-e79cb8155e154e09","baggage":"sentry-trace_id=cb764f87ff2746079c49efa8dde2a89f,sentry-release=Unknown"},"correlation_id":"01KZR38DFTRP27PR0117JWZKZQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-11T09:43:02.664Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m9b1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-b3beda5f5c526f5055424013: done: 0.027648 sec","job_status":"done","queue_duration_s":0.1087,"scheduling_latency_s":0.108732,"redis_calls":7,"redis_duration_s":0.0016979999999999999,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001259,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000439,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019058,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027648,"completed_at":"2026-08-11T09:43:02.801Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003368,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2024gitlab # [ 225.095737] gitaly[1381]: time="2026-08-11T09:43:02.744Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR38ES2GF7ETKK2WARDE18N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T09:43:32.742" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:43:02.743" grpc.time_ms=0.852 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2025gitlab # [ 225.115601] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:43:03 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/f40b211475671ebb570f445080aee2bc707d4975/statuses HTTP/1.1" 200 1307 "" "curl/8.20.0" 1512026gitlab # [ 225.119409] gitaly[1381]: time="2026-08-11T09:43:02.756Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR38DFTRP27PR0117JWZKZQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T09:43:32.454" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:43:02.754" grpc.time_ms=1.16 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2027gitlab # [ 225.139122] gitaly[1381]: time="2026-08-11T09:43:03.844Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR38FVY3GZQP32XP7FXEQ8Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T09:43:33.842" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:43:03.843" grpc.time_ms=0.826 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2028gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f40b211475671ebb570f445080aee2bc707d4975/statuses2029gitlab # [ 226.124503] gitaly[1381]: time="2026-08-11T09:43:05.074Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR38H1H7QDK7P3SYNG81C2T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T09:43:35.072" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:43:05.073" grpc.time_ms=1.121 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2030gitlab # [ 226.190821] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:43:05 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/f40b211475671ebb570f445080aee2bc707d4975/statuses HTTP/1.1" 200 1307 "" "curl/8.20.0" 1302031gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f40b211475671ebb570f445080aee2bc707d4975/statuses, in 0.19 seconds)2032gitlab # [ 227.137423] nix-daemon[3434]: accepted connection from pid 3735, user nixbot2033gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f40b211475671ebb570f445080aee2bc707d4975/statuses2034gitlab # [ 227.284800] gitaly[1381]: time="2026-08-11T09:43:06.235Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR38J4MRNMDEPQKK6602HM2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T09:43:36.232" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:43:06.233" grpc.time_ms=1.536 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2035gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f40b211475671ebb570f445080aee2bc707d4975/statuses, in 0.13 seconds)2036gitlab # [ 227.326119] gitaly[1381]: time="2026-08-11T09:43:06.246Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR38J6GTEYXZ2DT3RRRW70R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T09:43:36.243" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:43:06.244" grpc.time_ms=0.955 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2037gitlab # [ 227.346931] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:43:06 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/f40b211475671ebb570f445080aee2bc707d4975/statuses HTTP/1.1" 200 1307 "" "curl/8.20.0" 762038gitlab # [ 227.351488] gitaly[1381]: time="2026-08-11T09:43:06.287Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR38J4MRNMDEPQKK6602HM2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-11T09:43:16.237" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T09:43:06.278" grpc.time_ms=8.305 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2039gitlab # [ 227.373142] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:06.319Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"3b11251461a87813a9fe9240","created_at":"2026-08-11T09:43:06.314Z","trace_propagation_headers":{"sentry-trace":"56258ac77d5e432694ae3f5954340a49-cd941a33b86b44aa","baggage":"sentry-trace_id=56258ac77d5e432694ae3f5954340a49,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR38J4MRNMDEPQKK6602HM2","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-11T09:43:06.317Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m9b1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-3b11251461a87813a9fe9240: start","job_status":"start","queue_duration_s":0.001714,"scheduling_latency_s":0.001764}2040gitlab # [ 227.398655] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:43:06 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f40b211475671ebb570f445080aee2bc707d4975 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1972041gitlab # [ 227.400154] nixbot[3159]: {"ts": "2026-08-11T09:43:06.331Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f40b211475671ebb570f445080aee2bc707d4975 \"HTTP/1.1 201 Created\""}2042gitlab # [ 227.451118] nix-daemon[3434]: accepted connection from pid 3755, user nixbot2043gitlab # [ 227.508655] gitaly[1381]: time="2026-08-11T09:43:06.459Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR38J4MRNMDEPQKK6602HM2 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3899 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T09:43:06.454" grpc.time_ms=3.595 pid=1381 span.kind=server system=grpc2044gitlab # [ 227.549677] gitaly[1381]: time="2026-08-11T09:43:06.499Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR38J4MRNMDEPQKK6602HM2 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T09:43:06.498" grpc.time_ms=1.539 pid=1381 span.kind=server system=grpc2045gitlab # [ 227.577440] gitaly[1381]: time="2026-08-11T09:43:06.528Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=28 command.spawn_token_fork_ms=4 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR38JEF5M6MXWP1YVYKFWA7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T09:43:06.498" grpc.time_ms=30.052 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc2046gitlab # [ 227.578876] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:43:06 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 822047gitlab # [ 227.620431] gitaly[1381]: time="2026-08-11T09:43:06.572Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KZR38J4MRNMDEPQKK6602HM2 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3899 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-11T09:43:06.569" grpc.time_ms=2.157 pid=1381 span.kind=server system=grpc2048gitlab # [ 227.638121] gitaly[1381]: time="2026-08-11T09:43:06.589Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01KZR38J4MRNMDEPQKK6602HM2 forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T09:43:36.122" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-11T09:43:06.422" operations="[repack_refs]" pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2049gitlab # [ 227.643110] gitaly[1381]: time="2026-08-11T09:43:06.593Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01KZR38J4MRNMDEPQKK6602HM2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T09:43:36.122" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-11T09:43:06.422" pid=1381 remote_ip="2001:db8:1::1" repository_info="{false {6 703 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-08-11 09:42:43.602937361 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2050gitlab # [ 227.649663] gitaly[1381]: time="2026-08-11T09:43:06.601Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KZR38J4MRNMDEPQKK6602HM2 diskcache=566c526d-b42b-4429-a38d-e0c691a27661 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T09:43:36.122" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-11T09:43:06.422" pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2051gitlab # [ 227.650935] gitaly[1381]: time="2026-08-11T09:43:06.601Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=101 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=6914 command.oublock=0 command.real_time_ms=164 command.spawn_token_fork_ms=2 command.system_time_ms=76 command.user_time_ms=25 component=gitaly.UnaryServerInterceptor correlation_id=01KZR38J4MRNMDEPQKK6602HM2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T09:43:36.122" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-11T09:43:06.422" grpc.time_ms=178.588 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2052gitlab # [ 227.673242] gitaly[1381]: time="2026-08-11T09:43:06.624Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01KZR38J4MRNMDEPQKK6602HM2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T09:43:36.122" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-11T09:43:06.422" pid=1381 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2053gitlab # [ 227.674800] gitaly[1381]: time="2026-08-11T09:43:06.625Z" level=info msg="optimized repository" clean_stale_data_time=30.776816ms clean_work_trees_time="104.483µs" commit_graph_time="8.381µs" correlation_id=01KZR38J4MRNMDEPQKK6602HM2 gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="18.997µs" pid=1381 prune_time="7.822µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="8.939µs" storage_name=default system=housekeeping total_time=31.134404ms2054gitlab # [ 227.675856] gitaly[1381]: time="2026-08-11T09:43:06.625Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01KZR38J4MRNMDEPQKK6602HM2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-11T09:43:36.122" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-11T09:43:06.422" pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2055gitlab # [ 227.744075] gitaly[1381]: time="2026-08-11T09:43:06.693Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KZR38J4MRNMDEPQKK6602HM2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-11T09:43:36.390" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:43:06.691" grpc.time_ms=1.637 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2056gitlab # [ 227.796057] gitaly[1381]: time="2026-08-11T09:43:06.747Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR38J4MRNMDEPQKK6602HM2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T09:43:36.445" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:43:06.746" grpc.time_ms=0.909 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2057gitlab # [ 227.805499] gitaly[1381]: time="2026-08-11T09:43:06.757Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KZR38JH513HMK5FBF082EH31 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T09:43:06.748" pid=1381 remote_ip="2001:db8:1::1" request_sha=cc69fbe136984084848b4359b2caac0b76309173 response_bytes=67 span.kind=server system=grpc2058gitlab # [ 227.806810] gitaly[1381]: time="2026-08-11T09:43:06.757Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR38JH513HMK5FBF082EH31 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T09:43:06.748" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc2059gitlab # [ 227.807970] gitlab-workhorse[1283]: time="2026-08-11T09:43:06Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672060gitlab # [ 227.809088] gitlab-workhorse[1283]: gitlab 2001:db8:1::1 - - [2026/08/11:09:43:06 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.54.0" 2242061gitlab # [ 227.809946] gitaly[1381]: time="2026-08-11T09:43:06.757Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR38JH513HMK5FBF082EH31 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-11T09:43:06.748" grpc.time_ms=8.652 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc2062gitlab # [ 227.961530] nix-daemon[3434]: accepted connection from pid 3813, user nixbot2063gitlab # [ 227.976513] gitaly[1381]: time="2026-08-11T09:43:06.928Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KZR38J4MRNMDEPQKK6602HM2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-11T09:43:36.626" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-11T09:43:06.926" grpc.time_ms=0.812 pid=1381 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2064gitlab # [ 228.026458] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:06.977Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"3b11251461a87813a9fe9240","created_at":"2026-08-11T09:43:06.314Z","trace_propagation_headers":{"sentry-trace":"56258ac77d5e432694ae3f5954340a49-cd941a33b86b44aa","baggage":"sentry-trace_id=56258ac77d5e432694ae3f5954340a49,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KZR38J4MRNMDEPQKK6602HM2","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-11T09:43:06.317Z","job_size_bytes":3,"pid":2141,"sidekiq_tid":"m9b1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-3b11251461a87813a9fe9240: done: 0.658114 sec","job_status":"done","queue_duration_s":0.001714,"scheduling_latency_s":0.001764,"gitaly_calls":4,"gitaly_duration_s":0.319342,"redis_calls":83,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.083298,"redis_read_bytes":181,"redis_write_bytes":20929,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.012963,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":21,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.005437,"redis_cache_read_bytes":39,"redis_cache_write_bytes":1840,"redis_queues_calls":23,"redis_queues_duration_s":0.026733,"redis_queues_read_bytes":33,"redis_queues_write_bytes":13382,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.021695,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3094,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000257,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000673,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002577,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":36,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.104,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":21,"db_ci_count":15,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.013,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.025,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.067,"db_ci_duration_s":0.037,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.142594,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.614183087,"duration_s":0.658114,"completed_at":"2026-08-11T09:43:06.977Z","load_balancing_strategy":"primary","db_duration_s":0.11817,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2065gitlab # [ 228.123374] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:07.074Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"53c0b169410e5d9ae713f5ee","created_at":"2026-08-11T09:43:06.376Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e096e12191173d52e05319ba25239a20","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-11T09:43:06.412Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m9b1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-53c0b169410e5d9ae713f5ee: start","job_status":"start","queue_duration_s":0.661375,"scheduling_latency_s":0.661448}2066gitlab # [ 228.162261] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:07.113Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}2067gitlab # [ 228.176180] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:07.127Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"53c0b169410e5d9ae713f5ee","created_at":"2026-08-11T09:43:06.376Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e096e12191173d52e05319ba25239a20","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-11T09:43:06.412Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m9b1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-53c0b169410e5d9ae713f5ee: done: 0.053024 sec","job_status":"done","queue_duration_s":0.661375,"scheduling_latency_s":0.661448,"redis_calls":9,"redis_duration_s":0.010156,"redis_read_bytes":7,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001252,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.007514,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00139,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026865,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.053024,"completed_at":"2026-08-11T09:43:07.126Z","load_balancing_strategy":"primary","db_duration_s":0.001006,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2068gitlab # [ 228.178851] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:07.130Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"2a8e18d3609403f70d3bf270","created_at":"2026-08-11T09:43:06.414Z","trace_propagation_headers":{"sentry-trace":"56258ac77d5e432694ae3f5954340a49-0e418f1b5c834553","baggage":"sentry-trace_id=56258ac77d5e432694ae3f5954340a49,sentry-release=Unknown"},"correlation_id":"01KZR38J4MRNMDEPQKK6602HM2","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-11T09:43:06.416Z","job_size_bytes":23,"pid":2141,"sidekiq_tid":"m9b1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-2a8e18d3609403f70d3bf270: start","job_status":"start","queue_duration_s":0.71311,"scheduling_latency_s":0.713151}2069gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f40b211475671ebb570f445080aee2bc707d4975/statuses2070gitlab # [ 228.222555] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:07.173Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"2a8e18d3609403f70d3bf270","created_at":"2026-08-11T09:43:06.414Z","trace_propagation_headers":{"sentry-trace":"56258ac77d5e432694ae3f5954340a49-0e418f1b5c834553","baggage":"sentry-trace_id=56258ac77d5e432694ae3f5954340a49,sentry-release=Unknown"},"correlation_id":"01KZR38J4MRNMDEPQKK6602HM2","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-11T09:43:06.416Z","job_size_bytes":23,"pid":2141,"sidekiq_tid":"m9b1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-2a8e18d3609403f70d3bf270: done: 0.043702 sec","job_status":"done","queue_duration_s":0.71311,"scheduling_latency_s":0.713151,"redis_calls":7,"redis_duration_s":0.002179,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001608,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000571,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031437,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.043702,"completed_at":"2026-08-11T09:43:07.173Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006475,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2071gitlab # [ 228.269356] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:07.175Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"7a442363204e7d99430d153d","created_at":"2026-08-11T09:43:06.429Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab8315811e73af2824b10ec707f13d8c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-11T09:43:06.436Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m9b1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-7a442363204e7d99430d153d: start","job_status":"start","queue_duration_s":0.738749,"scheduling_latency_s":0.738778}2072gitlab # [ 228.292091] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:07.186Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}2073gitlab # [ 228.297971] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:07.191Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"7a442363204e7d99430d153d","created_at":"2026-08-11T09:43:06.429Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab8315811e73af2824b10ec707f13d8c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-11T09:43:06.436Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m9b1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-7a442363204e7d99430d153d: done: 0.016346 sec","job_status":"done","queue_duration_s":0.738749,"scheduling_latency_s":0.738778,"redis_calls":9,"redis_duration_s":0.002146,"redis_read_bytes":7,"redis_write_bytes":1105,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000489,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001183,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000474,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010478,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016346,"completed_at":"2026-08-11T09:43:07.191Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00049,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2074gitlab # [ 228.394654] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:07.192Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"1446bb1a299f82c8b2b4e981","created_at":"2026-08-11T09:43:06.442Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f7fb4767a4dc18cb230b1db8b46d43eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-11T09:43:06.446Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m9b1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-1446bb1a299f82c8b2b4e981: start","job_status":"start","queue_duration_s":0.746563,"scheduling_latency_s":0.746584}2075gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/f40b211475671ebb570f445080aee2bc707d4975/statuses, in 0.14 seconds)2076(finished: subtest: eval and build post commit statuses, in 12.98 seconds)2077(finished: run the VM test script, in 264.16 seconds)2078gitlab # [ 228.401250] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:07.294Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"1446bb1a299f82c8b2b4e981","created_at":"2026-08-11T09:43:06.442Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f7fb4767a4dc18cb230b1db8b46d43eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-11T09:43:06.446Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m9b1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-1446bb1a299f82c8b2b4e981: done: 0.101559 sec","job_status":"done","queue_duration_s":0.746563,"scheduling_latency_s":0.746584,"redis_calls":70,"redis_duration_s":0.023437,"redis_read_bytes":118,"redis_write_bytes":42480,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002316,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001309,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37385,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.018903,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000909,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.078363,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.101559,"completed_at":"2026-08-11T09:43:07.294Z","load_balancing_strategy":"primary","db_duration_s":0.00186,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2079gitlab # [ 228.453418] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:07.296Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"c5863d98dbcad716a295631d","created_at":"2026-08-11T09:43:06.453Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"67cf871f8b49bdaa4f6bff91380543eb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-11T09:43:06.458Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m9b1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-c5863d98dbcad716a295631d: start","job_status":"start","queue_duration_s":0.838612,"scheduling_latency_s":0.838644}2080test script finished in 264.25s2081cleanup2082kill QemuMachine (pid 13)2083gitlab # [ 228.544180] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-08-11T09:43:07.319Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"c5863d98dbcad716a295631d","created_at":"2026-08-11T09:43:06.453Z","trace_propagation_headers":{"sentry-trace":"fbc15dcdd4214264a84a9a18abbc7126-06b1783db85a40b0","baggage":"sentry-trace_id=fbc15dcdd4214264a84a9a18abbc7126,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"67cf871f8b49bdaa4f6bff91380543eb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_cqemu-system-x86_64: terminating on signal 15 from pid 6 (/nix/store/60m4rxhg2fldqaak400c0lry96ijrzqn-python3-3.13.13/bin/python3.13)2084gitlab # o2085(finished: cleanup, in 1.44 seconds)2086additionally exposed symbols:2087 gitlab,2088 vlan1,2089 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2090[]2091[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-11T09:42:49.095Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2092[]2093[]2094[]2095[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': 'f40b211475671ebb570f445080aee2bc707d4975', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-11T09:42:53.867439Z', 'started_at': '2026-08-11T09:42:54.353297Z', 'finished_at': None}]2096[{'id': 2, 'sha': 'f40b211475671ebb570f445080aee2bc707d4975', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-11T09:42:54.323Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2097[{'id': 2, 'sha': 'f40b211475671ebb570f445080aee2bc707d4975', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-11T09:42:54.323Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2098[{'id': 2, 'sha': 'f40b211475671ebb570f445080aee2bc707d4975', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-11T09:42:54.323Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2099[{'id': 2, 'sha': 'f40b211475671ebb570f445080aee2bc707d4975', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-11T09:42:54.323Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2100[{'id': 2, 'sha': 'f40b211475671ebb570f445080aee2bc707d4975', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-11T09:42:54.323Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2101[{'id': 2, 'sha': 'f40b211475671ebb570f445080aee2bc707d4975', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-11T09:42:54.323Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2102[{'id': 2, 'sha': 'f40b211475671ebb570f445080aee2bc707d4975', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-11T09:42:54.323Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2103[{'id': 2, 'sha': 'f40b211475671ebb570f445080aee2bc707d4975', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-11T09:42:54.323Z', 'started_at': None, 'finished_at': '2026-08-11T09:43:01.536Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 4, 'sha': 'f40b211475671ebb570f445080aee2bc707d4975', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'building attributes', 'created_at': '2026-08-11T09:43:01.716Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2104[{'id': 2, 'sha': 'f40b211475671ebb570f445080aee2bc707d4975', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-11T09:42:54.323Z', 'started_at': None, 'finished_at': '2026-08-11T09:43:01.536Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 4, 'sha': 'f40b211475671ebb570f445080aee2bc707d4975', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'building attributes', 'created_at': '2026-08-11T09:43:01.716Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2105[{'id': 2, 'sha': 'f40b211475671ebb570f445080aee2bc707d4975', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-11T09:42:54.323Z', 'started_at': None, 'finished_at': '2026-08-11T09:43:01.536Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 4, 'sha': 'f40b211475671ebb570f445080aee2bc707d4975', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'building attributes', 'created_at': '2026-08-11T09:43:01.716Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2106[{'id': 2, 'sha': 'f40b211475671ebb570f445080aee2bc707d4975', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-11T09:42:54.323Z', 'started_at': None, 'finished_at': '2026-08-11T09:43:01.536Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 4, 'sha': 'f40b211475671ebb570f445080aee2bc707d4975', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'building attributes', 'created_at': '2026-08-11T09:43:01.716Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2107[{'id': 2, 'sha': 'f40b211475671ebb570f445080aee2bc707d4975', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-11T09:42:54.323Z', 'started_at': None, 'finished_at': '2026-08-11T09:43:01.536Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 4, 'sha': 'f40b211475671ebb570f445080aee2bc707d4975', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-08-11T09:43:01.716Z', 'started_at': None, 'finished_at': '2026-08-11T09:43:06.307Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]