vm-test-run-nixbot-gitlab
checks.x86_64-linux.nixbot-gitlab
· build #377
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab # Disk image does not exist, creating the virtualisation disk image...10gitlab: QEMU running (pid 46)11gitlab # Formatting '/build/vm-state-gitlab/tmp.X4S8KRLJuE', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13gitlab # Discarding device blocks: 0/262144 done14(finished: start all VMs, in 46.42 seconds)15gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes16gitlab # Filesystem UUID: fe3e9fab-d053-4de3-82c6-92416d3e2f2817gitlab # Superblock backups stored on blocks:18gitlab: waiting for unit setup-gitlab.service19gitlab # 32768, 98304, 163840, 22937620gitlab # 21gitlab # Allocating group tables: 0/8 done22gitlab # Writing inode tables: 0/8 done23gitlab # Creating journal (8192 blocks): done24gitlab # Writing superblocks and filesystem accounting information: 0/8 done25gitlab # 26gitlab # Virtualisation disk image created.27gitlab # Creating Nix store image...28gitlab # Created Nix store image.29gitlab: waiting for the VM to finish booting30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 202645gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/6qzh9bg13qnkfdl1fqzd2jqgccf4h6w6-nixos-system-gitlab-test/init regInfo=/nix/store/vxsgzw82dsijlaq3yif2lra1gzbx6xb7-closure-info/registration console=ttyS0,115200n8 console=tty046gitlab # [ 0.000000] BIOS-provided physical RAM map:47gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable48gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved49gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable51gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable55gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved56gitlab # [ 0.000000] NX (Execute Disable) protection: active57gitlab # [ 0.000000] APIC: Static calls initialized58gitlab # [ 0.000000] SMBIOS 2.8 present.59gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201460gitlab # [ 0.000000] DMI: Memory slots populated: 1/161gitlab # [ 0.000000] Hypervisor detected: KVM62gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000063gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0064gitlab # [ 0.000000] kvm-clock: using sched offset of 450069961 cycles65gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns66gitlab # [ 0.000004] tsc: Detected 2400.012 MHz processor67gitlab # [ 0.000809] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000068gitlab # [ 0.000835] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs69gitlab # [ 0.000838] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT70gitlab # [ 0.000874] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000071gitlab # [ 0.002745] found SMP MP-table at [mem 0x000f5470-0x000f547f]72gitlab # [ 0.002756] Using GB pages for direct mapping73gitlab # [ 0.002924] RAMDISK: [mem 0xbe31c000-0xbffcffff]74gitlab # [ 0.002930] ACPI: Early table checksum verification disabled75gitlab # [ 0.002933] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )76gitlab # [ 0.002937] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)77gitlab # [ 0.002940] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002946] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002948] ACPI: FACS 0x00000000BFFE0000 00004080gitlab # [ 0.002949] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)81gitlab # [ 0.002951] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002952] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002954] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]84gitlab # [ 0.002955] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]85gitlab # [ 0.002955] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]86gitlab # [ 0.002956] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]87gitlab # [ 0.002956] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]88gitlab # [ 0.002957] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]89gitlab # [ 0.003168] No NUMA configuration found90gitlab # [ 0.003169] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]91gitlab # [ 0.003171] NODE_DATA(0) allocated [mem 0x1bfff8780-0x1bfffdcff]92gitlab # [ 0.005305] Zone ranges:93gitlab # [ 0.005306] DMA [mem 0x0000000000001000-0x0000000000ffffff]94gitlab # [ 0.005307] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]95gitlab # [ 0.005308] Normal [mem 0x0000000100000000-0x00000001bfffffff]96gitlab # [ 0.005309] Device empty97gitlab # [ 0.005310] Movable zone start for each node98gitlab # [ 0.005310] Early memory node ranges99gitlab # [ 0.005311] node 0: [mem 0x0000000000001000-0x000000000009efff]100gitlab # [ 0.005312] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]101gitlab # [ 0.005313] node 0: [mem 0x0000000100000000-0x00000001bfffffff]102gitlab # [ 0.005314] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]103gitlab # [ 0.005332] On node 0, zone DMA: 1 pages in unavailable ranges104gitlab # [ 0.005587] On node 0, zone DMA: 97 pages in unavailable ranges105gitlab # [ 0.106417] On node 0, zone Normal: 40 pages in unavailable ranges106gitlab # [ 0.106836] ACPI: PM-Timer IO Port: 0x608107gitlab # [ 0.106851] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])108gitlab # [ 0.106881] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23109gitlab # [ 0.106884] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)110gitlab # [ 0.106886] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)111gitlab # [ 0.106887] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)112gitlab # [ 0.106888] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)113gitlab # [ 0.106889] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)114gitlab # [ 0.106892] ACPI: Using ACPI (MADT) for SMP configuration information115gitlab # [ 0.106893] ACPI: HPET id: 0x8086a201 base: 0xfed00000116gitlab # [ 0.106897] TSC deadline timer available117gitlab # [ 0.106902] CPU topo: Max. logical packages: 1118gitlab # [ 0.106903] CPU topo: Max. logical dies: 1119gitlab # [ 0.106903] CPU topo: Max. dies per package: 1120gitlab # [ 0.106907] CPU topo: Max. threads per core: 1121gitlab # [ 0.106907] CPU topo: Num. cores per package: 4122gitlab # [ 0.106908] CPU topo: Num. threads per package: 4123gitlab # [ 0.106908] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs124gitlab # [ 0.106930] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()125gitlab # [ 0.106946] kvm-guest: KVM setup pv remote TLB flush126gitlab # [ 0.106949] kvm-guest: setup PV sched yield127gitlab # [ 0.106964] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]128gitlab # [ 0.106966] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]129gitlab # [ 0.106967] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]130gitlab # [ 0.106968] [mem 0xc0000000-0xfeffbfff] available for PCI devices131gitlab # [ 0.106970] Booting paravirtualized kernel on KVM132gitlab # [ 0.106973] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns133gitlab # [ 0.111403] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1134gitlab # [ 0.113493] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288135gitlab # [ 0.113537] kvm-guest: PV spinlocks enabled136gitlab # [ 0.113539] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)137gitlab # [ 0.113542] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/6qzh9bg13qnkfdl1fqzd2jqgccf4h6w6-nixos-system-gitlab-test/init regInfo=/nix/store/vxsgzw82dsijlaq3yif2lra1gzbx6xb7-closure-info/registration console=ttyS0,115200n8 console=tty0138gitlab # [ 0.113635] Unknown kernel command line parameters "regInfo=/nix/store/vxsgzw82dsijlaq3yif2lra1gzbx6xb7-closure-info/registration", will be passed to user space.139gitlab # [ 0.113649] random: crng init done140gitlab # [ 0.113650] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes141gitlab # [ 0.121894] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)142gitlab # [ 0.126085] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)143gitlab # [ 0.126154] software IO TLB: area num 4.144gitlab # [ 0.195482] Fallback order for Node 0: 0145gitlab # [ 0.195489] Built 1 zonelists, mobility grouping on. Total pages: 1572726146gitlab # [ 0.195491] Policy zone: Normal147gitlab # [ 0.197850] mem auto-init: stack:all(zero), heap alloc:on, heap free:off148gitlab # [ 0.206972] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1149gitlab # [ 0.219723] allocated 12582912 bytes of page_ext150gitlab # [ 0.229506] ftrace: allocating 48717 entries in 192 pages151gitlab # [ 0.229508] ftrace: allocated 192 pages with 2 groups152gitlab # [ 0.230317] Dynamic Preempt: lazy153gitlab # [ 0.230469] rcu: Preemptible hierarchical RCU implementation.154gitlab # [ 0.230469] rcu: RCU event tracing is enabled.155gitlab # [ 0.230470] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.156gitlab # [ 0.230471] Trampoline variant of Tasks RCU enabled.157gitlab # [ 0.230472] Rude variant of Tasks RCU enabled.158gitlab # [ 0.230472] Tracing variant of Tasks RCU enabled.159gitlab # [ 0.230473] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.160gitlab # [ 0.230473] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4161gitlab # [ 0.230493] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.162gitlab # [ 0.230494] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.230496] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.234762] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16165gitlab # [ 0.235075] rcu: srcu_init: Setting srcu_struct sizes based on contention.166gitlab # [ 0.235082] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns167gitlab # [ 0.235190] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)168gitlab # [ 0.238767] Console: colour VGA+ 80x25169gitlab # [ 0.238771] printk: legacy console [tty0] enabled170gitlab # [ 0.269138] printk: legacy console [ttyS0] enabled171gitlab # [ 0.376857] ACPI: Core revision 20250807172gitlab # [ 0.377798] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns173gitlab # [ 0.379391] APIC: Switch to symmetric I/O mode setup174gitlab # [ 0.380434] x2apic enabled175gitlab # [ 0.381177] APIC: Switched APIC routing to: physical x2apic176gitlab # [ 0.382133] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()177gitlab # [ 0.383363] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()178gitlab # [ 0.384899] kvm-guest: setup PV IPIs179gitlab # [ 0.386476] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1180gitlab # [ 0.387548] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns181gitlab # [ 0.389337] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)182gitlab # [ 0.391418] x86/cpu: User Mode Instruction Prevention (UMIP) activated183gitlab # [ 0.392458] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127184gitlab # [ 0.394334] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0185gitlab # [ 0.395338] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto186gitlab # [ 0.396334] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl187gitlab # [ 0.397335] Transient Scheduler Attacks: Vulnerable: No microcode188gitlab # [ 0.398334] Spectre V2 : Mitigation: Enhanced / Automatic IBRS189gitlab # [ 0.399334] Speculative Return Stack Overflow: Mitigation: Safe RET190gitlab # [ 0.401145] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization191gitlab # [ 0.402341] Spectre V2 : Enabling IBPB for BPF192gitlab # [ 0.403335] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier193gitlab # [ 0.404335] active return thunk: srso_alias_return_thunk194gitlab # [ 0.405355] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'195gitlab # [ 0.406334] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'196gitlab # [ 0.408148] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'197gitlab # [ 0.409148] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'198gitlab # [ 0.410334] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'199gitlab # [ 0.411333] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'200gitlab # [ 0.412334] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'201gitlab # [ 0.413335] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256202gitlab # [ 0.414334] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64203gitlab # [ 0.415334] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512204gitlab # [ 0.416334] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024205gitlab # [ 0.418136] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8206gitlab # [ 0.419130] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.207gitlab # [ 0.448624] Freeing SMP alternatives memory: 44K208gitlab # [ 0.449337] pid_max: default: 32768 minimum: 301209gitlab # [ 0.450376] LSM: initializing lsm=capability,landlock,yama,bpf,ima210gitlab # [ 0.451441] landlock: Up and running.211gitlab # [ 0.452086] Yama: becoming mindful.212gitlab # [ 0.452997] LSM support for eBPF active213gitlab # [ 0.453556] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)214gitlab # [ 0.454475] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)215gitlab # [ 0.456998] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)216gitlab # [ 0.457877] Performance Events: Fam17h+ core perfctr, AMD PMU driver.217gitlab # [ 0.458339] ... version: 2218gitlab # [ 0.459085] ... bit width: 48219gitlab # [ 0.459337] ... generic counters: 6220gitlab # [ 0.460090] ... generic bitmap: 000000000000003f221gitlab # [ 0.460347] ... fixed-purpose counters: 0222gitlab # [ 0.461085] ... fixed-purpose bitmap: 0000000000000000223gitlab # [ 0.461336] ... value mask: 0000ffffffffffff224gitlab # [ 0.462261] ... max period: 00007fffffffffff225gitlab # [ 0.463051] ... global_ctrl mask: 000000000000003f226gitlab # [ 0.463463] signal: max sigframe size: 3376227gitlab # [ 0.464284] rcu: Hierarchical SRCU implementation.228gitlab # [ 0.464984] rcu: Max phase no-delay instances is 400.229gitlab # [ 0.465514] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level230gitlab # [ 0.470929] smp: Bringing up secondary CPUs ...231gitlab # [ 0.471705] smpboot: x86: Booting SMP configuration:232gitlab # [ 0.472345] .... node #0, CPUs: #1 #2 #3233gitlab # [ 0.475554] smp: Brought up 1 node, 4 CPUs234gitlab # [ 0.477337] smpboot: Total of 4 processors activated (19200.09 BogoMIPS)235gitlab # [ 0.478674] Memory: 6011572K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260108K reserved, 0K cma-reserved)236gitlab # [ 0.480337] devtmpfs: initialized237gitlab # [ 0.481412] x86/mm: Memory block size: 128MB238gitlab # [ 0.484502] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)239gitlab # [ 0.486401] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).240gitlab # [ 0.487426] pinctrl core: initialized pinctrl subsystem241gitlab # [ 0.488654] PM: RTC time: 12:05:48, date: 2026-09-13242gitlab # [ 0.492257] NET: Registered PF_NETLINK/PF_ROUTE protocol family243gitlab # [ 0.494489] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations244gitlab # [ 0.495385] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations245gitlab # [ 0.497378] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations246gitlab # [ 0.498348] audit: initializing netlink subsys (disabled)247gitlab # [ 0.499395] audit: type=2000 audit(1789301149.232:1): state=initialized audit_enabled=0 res=1248gitlab # [ 0.499609] thermal_sys: Registered thermal governor 'fair_share'249gitlab # [ 0.501338] thermal_sys: Registered thermal governor 'bang_bang'250gitlab # [ 0.502337] thermal_sys: Registered thermal governor 'step_wise'251gitlab # [ 0.503338] thermal_sys: Registered thermal governor 'user_space'252gitlab # [ 0.504337] thermal_sys: Registered thermal governor 'power_allocator'253gitlab # [ 0.505352] cpuidle: using governor menu254gitlab # [ 0.507567] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5255gitlab # [ 0.508584] PCI: Using configuration type 1 for base access256gitlab # [ 0.509338] PCI: Using configuration type 1 for extended access257gitlab # [ 0.510549] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.258gitlab # [ 0.512621] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages259gitlab # [ 0.513339] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page260gitlab # [ 0.514337] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages261gitlab # [ 0.515337] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page262gitlab # [ 0.520810] ACPI: Added _OSI(Module Device)263gitlab # [ 0.522348] ACPI: Added _OSI(Processor Device)264gitlab # [ 0.524343] ACPI: Added _OSI(Processor Aggregator Device)265gitlab # [ 0.531429] ACPI: 1 ACPI AML tables successfully acquired and loaded266gitlab # [ 0.538632] ACPI: Interpreter enabled267gitlab # [ 0.539552] ACPI: PM: (supports S0 S3 S4 S5)268gitlab # [ 0.541345] ACPI: Using IOAPIC for interrupt routing269gitlab # [ 0.543621] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug270gitlab # [ 0.546342] PCI: Using E820 reservations for host bridge windows271gitlab # [ 0.549987] ACPI: Enabled 2 GPEs in block 00 to 0F272gitlab # [ 0.564551] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])273gitlab # [ 0.567412] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]274gitlab # [ 0.571592] acpiphp: Slot [3] registered275gitlab # [ 0.573398] acpiphp: Slot [4] registered276gitlab # [ 0.575382] acpiphp: Slot [5] registered277gitlab # [ 0.576400] acpiphp: Slot [6] registered278gitlab # [ 0.577382] acpiphp: Slot [7] registered279gitlab # [ 0.579381] acpiphp: Slot [8] registered280gitlab # [ 0.580381] acpiphp: Slot [9] registered281gitlab # [ 0.582401] acpiphp: Slot [10] registered282gitlab # [ 0.583383] acpiphp: Slot [11] registered283gitlab # [ 0.585388] acpiphp: Slot [12] registered284gitlab # [ 0.586398] acpiphp: Slot [13] registered285gitlab # [ 0.587382] acpiphp: Slot [14] registered286gitlab # [ 0.589380] acpiphp: Slot [15] registered287gitlab # [ 0.590379] acpiphp: Slot [16] registered288gitlab # [ 0.592396] acpiphp: Slot [17] registered289gitlab # [ 0.593382] acpiphp: Slot [18] registered290gitlab # [ 0.594327] acpiphp: Slot [19] registered291gitlab # [ 0.594908] acpiphp: Slot [20] registered292gitlab # [ 0.595370] acpiphp: Slot [21] registered293gitlab # [ 0.596081] acpiphp: Slot [22] registered294gitlab # [ 0.597358] acpiphp: Slot [23] registered295gitlab # [ 0.598109] acpiphp: Slot [24] registered296gitlab # [ 0.598390] acpiphp: Slot [25] registered297gitlab # [ 0.599102] acpiphp: Slot [26] registered298gitlab # [ 0.600360] acpiphp: Slot [27] registered299gitlab # [ 0.601124] acpiphp: Slot [28] registered300gitlab # [ 0.601366] acpiphp: Slot [29] registered301gitlab # [ 0.602085] acpiphp: Slot [30] registered302gitlab # [ 0.603642] acpiphp: Slot [31] registered303gitlab # [ 0.605434] PCI host bridge to bus 0000:00304gitlab # [ 0.607375] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]305gitlab # [ 0.609344] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]306gitlab # [ 0.612342] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]307gitlab # [ 0.615343] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]308gitlab # [ 0.618342] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]309gitlab # [ 0.621347] pci_bus 0000:00: root bus resource [bus 00-ff]310gitlab # [ 0.622587] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint311gitlab # [ 0.624866] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint312gitlab # [ 0.626802] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint313gitlab # [ 0.630086] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]314gitlab # [ 0.630365] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk315gitlab # [ 0.632338] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk316gitlab # [ 0.633336] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk317gitlab # [ 0.634337] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk318gitlab # [ 0.635562] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint319gitlab # [ 0.638368] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]320gitlab # [ 0.640434] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint321gitlab # [ 0.642605] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI322gitlab # [ 0.643345] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB323gitlab # [ 0.644561] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint324gitlab # [ 0.659437] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]325gitlab # [ 0.660350] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]326gitlab # [ 0.661359] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]327gitlab # [ 0.663527] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]328gitlab # [ 0.665128] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint329gitlab # [ 0.670374] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]330gitlab # [ 0.671301] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]331gitlab # [ 0.672274] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]332gitlab # [ 0.684365] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]333gitlab # [ 0.691004] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint334gitlab # [ 0.701381] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]335gitlab # [ 0.704358] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]336gitlab # [ 0.706397] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]337gitlab # [ 0.713530] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint338gitlab # [ 0.723383] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]339gitlab # [ 0.725359] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]340gitlab # [ 0.728416] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]341gitlab # [ 0.734446] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint342gitlab # [ 0.741371] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]343gitlab # [ 0.742352] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]344gitlab # [ 0.744384] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]345gitlab # [ 0.749804] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint346gitlab # [ 0.757386] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]347gitlab # [ 0.760363] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]348gitlab # [ 0.763403] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]349gitlab # [ 0.769979] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint350gitlab # [ 0.780362] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]351gitlab # [ 0.782352] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]352gitlab # [ 0.784383] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]353gitlab # [ 0.789904] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint354gitlab # [ 0.794375] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]355gitlab # [ 0.795262] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]356gitlab # [ 0.797360] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]357gitlab # [ 0.798343] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]358gitlab # [ 0.800606] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint359gitlab # [ 0.803350] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]360gitlab # [ 0.804359] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]361gitlab # [ 0.806956] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint362gitlab # [ 0.810384] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]363gitlab # [ 0.811312] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]364gitlab # [ 0.813156] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]365gitlab # [ 0.818709] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint366gitlab # [ 0.829364] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]367gitlab # [ 0.832359] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]368gitlab # [ 0.835398] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]369gitlab # [ 0.847796] ACPI: PCI: Interrupt link LNKA configured for IRQ 10370gitlab # [ 0.850722] ACPI: PCI: Interrupt link LNKB configured for IRQ 10371gitlab # [ 0.852691] ACPI: PCI: Interrupt link LNKC configured for IRQ 11372gitlab # [ 0.855699] ACPI: PCI: Interrupt link LNKD configured for IRQ 11373gitlab # [ 0.858540] ACPI: PCI: Interrupt link LNKS configured for IRQ 9374gitlab # [ 0.863609] iommu: Default domain type: Translated375gitlab # [ 0.865343] iommu: DMA domain TLB invalidation policy: lazy mode376gitlab # [ 0.869486] ACPI: bus type USB registered377gitlab # [ 0.871486] usbcore: registered new interface driver usbfs378gitlab # [ 0.873393] usbcore: registered new interface driver hub379gitlab # [ 0.874381] usbcore: registered new device driver usb380gitlab # [ 0.878849] NetLabel: Initializing381gitlab # [ 0.880341] NetLabel: domain hash size = 128382gitlab # [ 0.881340] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO383gitlab # [ 0.883652] NetLabel: unlabeled traffic allowed by default384gitlab # [ 0.885362] PCI: Using ACPI for IRQ routing385gitlab # [ 0.888474] pci 0000:00:02.0: vgaarb: setting as boot VGA device386gitlab # [ 0.889333] pci 0000:00:02.0: vgaarb: bridge control possible387gitlab # [ 0.889333] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none388gitlab # [ 0.896353] vgaarb: loaded389gitlab # [ 0.898045] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0390gitlab # [ 0.900341] hpet0: 3 comparators, 64-bit 100.000000 MHz counter391gitlab # [ 0.906335] clocksource: Switched to clocksource kvm-clock392gitlab # [ 0.913822] VFS: Disk quotas dquot_6.6.0393gitlab # [ 0.915646] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)394gitlab # [ 0.919457] pnp: PnP ACPI init395gitlab # [ 0.922374] pnp: PnP ACPI: found 6 devices396gitlab # [ 0.937219] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns397gitlab # [ 0.940907] clocksource: Switched to clocksource acpi_pm398gitlab # [ 0.943474] NET: Registered PF_INET protocol family399gitlab # [ 0.948465] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)400gitlab # [ 0.976533] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)401gitlab # [ 0.978077] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)402gitlab # [ 0.979557] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)403gitlab # [ 0.983391] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)404gitlab # [ 0.984765] TCP: Hash tables configured (established 65536 bind 65536)405gitlab # [ 0.986038] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)406gitlab # [ 0.987723] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)407gitlab # [ 0.989187] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)408gitlab # [ 0.990597] NET: Registered PF_UNIX/PF_LOCAL protocol family409gitlab # [ 0.991696] NET: Registered PF_XDP protocol family410gitlab # [ 0.992572] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]411gitlab # [ 0.993649] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]412gitlab # [ 0.994723] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]413gitlab # [ 0.995875] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]414gitlab # [ 0.997050] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]415gitlab # [ 0.998460] pci 0000:00:01.0: PIIX3: Enabling Passive Release416gitlab # [ 0.999478] pci 0000:00:00.0: Limiting direct PCI/PCI transfers417gitlab # [ 1.001918] ACPI: \_SB_.LNKD: Enabled at IRQ 11418gitlab # [ 1.004551] PCI: CLS 0 bytes, default 64419gitlab # [ 1.005359] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)420gitlab # [ 1.005858] Trying to unpack rootfs image as initramfs...421gitlab # [ 1.006546] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB)422gitlab # [ 1.006683] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns423gitlab # [ 1.030047] Initialise system trusted keyrings424gitlab # [ 1.031387] workingset: timestamp_bits=40 max_order=21 bucket_order=0425gitlab # [ 1.042910] Key type asymmetric registered426gitlab # [ 1.043692] Asymmetric key parser 'x509' registered427gitlab # [ 1.044620] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)428gitlab # [ 1.046445] io scheduler mq-deadline registered429gitlab # [ 1.047225] io scheduler kyber registered430gitlab # [ 1.050916] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled431gitlab # [ 1.052317] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A432gitlab # [ 1.054727] Linux agpgart interface v0.103433gitlab # [ 1.055528] ACPI: bus type drm_connector registered434gitlab # [ 1.057903] usbcore: registered new interface driver usbserial_generic435gitlab # [ 1.059095] usbserial: USB Serial support registered for generic436gitlab # [ 1.060143] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.437gitlab # [ 1.060143] Please enable it if your BIOS has the CPPC option.438gitlab # [ 1.062502] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled439gitlab # [ 1.063967] drop_monitor: Initializing network drop monitor service440gitlab # [ 1.065223] NET: Registered PF_INET6 protocol family441gitlab # [ 1.067105] Segment Routing with IPv6442gitlab # [ 1.067845] In-situ OAM (IOAM) with IPv6443gitlab # [ 1.071269] IPI shorthand broadcast: enabled444gitlab # [ 1.075661] sched_clock: Marking stable (929011527, 146251249)->(1098260488, -22997712)445gitlab # [ 1.077528] registered taskstats version 1446gitlab # [ 1.078613] Loading compiled-in X.509 certificates447gitlab # [ 1.088512] Demotion targets for Node 0: null448gitlab # [ 1.089677] Key type .fscrypt registered449gitlab # [ 1.090383] Key type fscrypt-provisioning registered450gitlab # [ 1.091366] ima: No TPM chip found, activating TPM-bypass!451gitlab # [ 1.092331] ima: Allocated hash algorithm: sha1452gitlab # [ 1.093184] ima: No architecture policies found453gitlab # [ 1.094320] PM: Magic number: 10:779:76454gitlab # [ 1.096026] RAS: Correctable Errors collector initialized.455gitlab # [ 1.100582] clk: Disabling unused clocks456gitlab # [ 1.101931] PM: genpd: Disabling unused power domains457gitlab # [ 1.320785] Freeing initrd memory: 29392K458gitlab # [ 1.328213] Freeing unused decrypted memory: 2028K459gitlab # [ 1.334737] Freeing unused kernel image (initmem) memory: 3640K460gitlab # [ 1.337460] Write protecting the kernel read-only data: 32768k461gitlab # [ 1.342418] Freeing unused kernel image (text/rodata gap) memory: 1220K462gitlab # [ 1.346350] Freeing unused kernel image (rodata/data gap) memory: 760K463gitlab # [ 1.414074] x86/mm: Checked W+X mappings: passed, no W+X pages found.464gitlab # [ 1.415340] Run /init as init process465gitlab # [ 1.429535] systemd[1]: Inserted module 'autofs4'466gitlab # [ 1.452676] fuse: init (API version 7.45)467gitlab # [ 1.461119] ACPI: \_SB_.LNKC: Enabled at IRQ 10468gitlab # [ 1.469490] ACPI: \_SB_.LNKA: Enabled at IRQ 10469gitlab # [ 1.472837] ACPI: \_SB_.LNKB: Enabled at IRQ 11470gitlab # [ 1.513175] systemd[1]: Successfully made /usr/ read-only.471gitlab # [ 1.849984] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)472gitlab # [ 1.890060] systemd[1]: Detected virtualization kvm.473gitlab # [ 1.892311] systemd[1]: Detected architecture x86-64.474gitlab # [ 1.894474] systemd[1]: Running in initrd.475gitlab # [ 1.896978] systemd[1]: Initializing machine ID from random generator.476gitlab # [ 1.899903] systemd[1]: Hostname set to <gitlab>.477gitlab # [ 2.012845] systemd[1]: bpf-restrict-fs: LSM BPF program attached478gitlab # [ 2.053428] systemd[1]: Queued start job for default target Initrd Default Target.479gitlab # [ 2.063938] systemd[1]: Created slice Slice /system/modprobe.480gitlab # [ 2.065164] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.481gitlab # [ 2.066610] systemd[1]: Expecting device /dev/disk/by-label/nix-store...482gitlab # [ 2.067793] systemd[1]: Expecting device /dev/disk/by-label/nixos...483gitlab # [ 2.068956] systemd[1]: Reached target Path Units.484gitlab # [ 2.069914] systemd[1]: Reached target Slice Units.485gitlab # [ 2.070838] systemd[1]: Reached target Swaps.486gitlab # [ 2.071692] systemd[1]: Reached target Timer Units.487gitlab # [ 2.072708] systemd[1]: Listening on D-Bus System Message Bus Socket.488gitlab # [ 2.073955] systemd[1]: Listening on Journal Socket (/dev/log).489gitlab # [ 2.075157] systemd[1]: Listening on Journal Sockets.490gitlab # [ 2.076171] systemd[1]: Listening on udev Control Socket.491gitlab # [ 2.077236] systemd[1]: Listening on udev Kernel Socket.492gitlab # [ 2.078209] systemd[1]: Reached target Socket Units.493gitlab # [ 2.080427] systemd[1]: Starting Create List of Static Device Nodes...494gitlab # [ 2.082583] systemd[1]: Starting Load Kernel Module 9pnet_virtio...495gitlab # [ 2.084666] systemd[1]: Starting Load Kernel Module configfs...496gitlab # [ 2.089343] systemd[1]: Starting Journal Service...497gitlab # [ 2.094497] systemd[1]: Starting Load Kernel Modules...498gitlab # [ 2.103591] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os499gitlab # [ 2.106343] systemd-journald[91]: Collecting audit messages is disabled.500gitlab # [ 2.121496] systemd[1]: Starting Coldplug All udev Devices...501gitlab # [ 2.138693] systemd[1]: Finished Create List of Static Device Nodes.502gitlab # [ 2.143734] systemd[1]: modprobe@configfs.service: Deactivated successfully.503gitlab # [ 2.147055] netfs: FS-Cache loaded504gitlab # [ 2.152172] systemd[1]: Finished Load Kernel Module configfs.505gitlab # [ 2.008518] systemd-modules-l[ 2.155064] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.506gitlab # oad[93]: Using 4 probe threads507gitlab # [ 2.011719] systemd-modules-l[ 2.158023] systemd[1]: Started Journal Service.508gitlab # oad[93]: Inserted module 'virtio_balloon'509gitlab # [ 2.014043] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config510gitlab # [ 2.017441] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...511gitlab # [ 2.163999] 9pnet: Installing 9P2000 support512gitlab # [ 2.165882] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev513gitlab # [ 2.022561] systemd-modules-load[93]: Inserted module 'dm_mod'514gitlab # [ 2.025088] systemd-modules-load[93]: Inserted module 'virtio_gpu'515gitlab # [ 2.027658] systemd[1]: Finished Load Kernel Modules.516gitlab # [ 2.031104] systemd[1]: Starting Apply Kernel Variables...517gitlab # [ 2.031914] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.518gitlab # [ 2.033197] systemd[1]: Finished Load Kernel Module 9pnet_virtio.519gitlab # [ 2.038528] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.520gitlab # [ 2.040154] systemd[1]: Starting Create Static Device Nodes in /dev...521gitlab # [ 2.048548] systemd[1]: Finished Apply Kernel Variables.522gitlab # [ 2.055918] systemd[1]: Finished Create Static Device Nodes in /dev.523gitlab # [ 2.057028] systemd[1]: Reached target Preparation for Local File Systems.524gitlab # [ 2.058118] systemd[1]: Reached target Local File Systems.525gitlab # [ 2.058905] systemd[1]: Starting Create System Files and Directories...526gitlab # [ 2.060161] systemd[1]: Starting Rule-based Manager for Device Events and Files...527gitlab # [ 2.075214] systemd[1]: Finished Create System Files and Directories.528gitlab # [ 2.081078] systemd-udevd[114]: Using default interface naming scheme 'v261'.529gitlab # [ 2.092178] systemd[1]: Started Rule-based Manager for Device Events and Files.530gitlab # [ 2.123200] systemd[1]: Finished Coldplug All udev Devices.531gitlab # [ 2.124802] systemd[1]: Reached target System Initialization.532gitlab # [ 2.126115] systemd[1]: Reached target Basic System.533gitlab # [ 2.349062] SCSI subsystem initialized534gitlab # [ 2.375282] uhci_hcd 0000:00:01.2: UHCI Host Controller535gitlab # [ 2.376982] virtio_blk virtio4: 4/0/0 default/read/poll queues536gitlab # [ 2.377939] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1537gitlab # [ 2.378882] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12538gitlab # [ 2.379945] uhci_hcd 0000:00:01.2: detected 2 ports539gitlab # [ 2.381725] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140540gitlab # [ 2.381839] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)541gitlab # [ 2.384685] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18542gitlab # [ 2.386456] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1543gitlab # [ 2.387388] scsi host0: ata_piix544gitlab # [ 2.387830] usb usb1: Product: UHCI Host Controller545gitlab # [ 2.388013] serio: i8042 KBD port at 0x60,0x64 irq 1546gitlab # [ 2.388024] serio: i8042 AUX port at 0x60,0x64 irq 12547gitlab # [ 2.390619] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd548gitlab # [ 2.391456] usb usb1: SerialNumber: 0000:00:01.2549gitlab # [ 2.392997] scsi host1: ata_piix550gitlab # [ 2.393764] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0551gitlab # [ 2.395093] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0552gitlab # [ 2.397553] virtio_blk virtio5: 4/0/0 default/read/poll queues553gitlab # [ 2.400363] hub 1-0:1.0: USB hub found554gitlab # [ 2.400970] hub 1-0:1.0: 2 ports detected555gitlab # [ 2.401714] virtio_blk virtio5: [vdb] 11843576 512-byte logical blocks (6.06 GB/5.65 GiB)556gitlab # [ 2.282990] systemd[1]: Starting Virtual Console Setup...557gitlab # [ 2.308364] systemd-vconsole-setup[153]: Configuration of first virtual console was skipped, ignoring remaining ones.558gitlab # [ 2.310085] systemd[1]: Finished Virtual Console Setup.559gitlab # [ 2.557725] ata2: found unknown device (class 0)560gitlab # [ 2.558976] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100561gitlab # [ 2.562829] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5562gitlab # [ 2.451823] (udev-worker)[122]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.563gitlab # [ 2.457153] (udev-worker)[122]: Network interface NamePolicy= disabled on kernel command line.564gitlab # [ 2.462377] (udev-worker)[128]: Network interface NamePolicy= disabled on kernel command line.565gitlab # [ 2.610959] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0566gitlab # [ 2.621355] usb 1-1: new full-speed USB device number 2 using uhci_hcd567gitlab # [ 2.492638] systemd[1]: Found device /dev/disk/by-label/nixos.568gitlab # [ 2.498148] systemd[1]: Found device /dev/dis[ 2.644559] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray569gitlab # k/by-label/nix-store.570gitlab # [ 2.502053] systemd[1]: Reached target Initrd Root Device.571gitlab # [ 2.504867] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...572gitlab # [ 2.679036] cdrom: Uniform CD-ROM driver Revision: 3.20573gitlab # [ 2.544507] systemd-fsck[160]: nixos: clean, 12/65536 files, 13019/262144 blocks574gitlab # [ 2.550306] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.575gitlab # [ 2.790424] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00576gitlab # [ 2.793824] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10577gitlab # [ 2.796566] usb 1-1: Product: QEMU USB Tablet578gitlab # [ 2.798142] usb 1-1: Manufacturer: QEMU579gitlab # [ 2.799637] usb 1-1: SerialNumber: 28754-0000:00:01.2-1580gitlab # [ 2.845914] hid: raw HID events driver (C) Jiri Kosina581gitlab # [ 2.859381] usbcore: registered new interface driver usbhid582gitlab # [ 2.861998] usbhid: USB HID core driver583gitlab # [ 2.871472] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2584gitlab # [ 2.875573] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0585gitlab # [ 2.985487] systemd[1]: Mounting /sysroot...586gitlab # [ 3.282976] EXT4-fs (vda): mounted filesystem fe3e9fab-d053-4de3-82c6-92416d3e2f28 r/w with ordered data mode. Quota mode: none.587gitlab # [ 3.143765] systemd[1]: Mounted /sysroot.588gitlab # [ 3.145348] systemd[1]: Reached target Initrd Root File System.589gitlab # [ 3.148672] systemd[1]: Mounting /sysroot/nix/.ro-store...590gitlab # [ 3.150851] systemd[1]: Mounting /sysroot/nix/.rw-store...591gitlab # [ 3.160746] systemd[1]: Mounting /sysroot/run...592gitlab # [ 3.166590] systemd[1]: Mounting /sysroot/tmp/shared...593gitlab # [ 3.171082] systemd[1]: Mounting /sysroot/tmp/xchg...594gitlab # [ 3.178148] systemd[1]: Starting Mountpoints Configured in the Real Root...595gitlab # [ 3.180966] systemd-sysroot-fstab-check[182]: /sysroot should be mounted in the initrd, will request daemon-reload.596gitlab # [ 3.188711] systemd[1]: Mounted /sysroot/nix/.rw-store.597gitlab # [ 3.335964] erofs (device vdb): mounted with root inode @ nid 128.598gitlab # [ 3.194451] systemd[1]: Mounted /sysroot/run.599gitlab # [ 3.196081] systemd[1]: 3.342401] 9p: Installing v9fs 9p2000 file system support600gitlab # ;39mReload requested from client PID 182 ('systemd-sysroot') (unit initrd-parse-etc.service)...601gitlab # [ 3.200267] systemd[1]: Reloading...602gitlab # [ 3.249822] systemd[1]: Reloading finished in 65 ms.603gitlab # [ 3.271788] systemd-sysroot-fstab-check[182]: Requesting initrd-fs.target/start/replace...604gitlab # [ 3.274721] systemd[1]: Mounted /sysroot/nix/.ro-store.605gitlab # [ 3.276586] systemd[1]: Mounted /sysroot/tmp/shared.606gitlab # [ 3.278323] systemd[1]: Mounted /sysroot/tmp/xchg.607gitlab # [ 3.280117] systemd-sysroot-fstab-check[182]: Requesting swap.target/start/replace...608gitlab # [ 3.282868] systemd[1]: Starting rw-sysroot-nix-store.service...609gitlab # [ 3.285252] systemd[1]: initrd-parse-etc.service: Deactivated successfully.610gitlab # [ 3.287673] systemd[1]: Finished Mountpoints Configured in the Real Root.611gitlab # [ 3.290111] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.612gitlab # [ 3.300595] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.613gitlab # [ 3.303363] systemd[1]: Finished rw-sysroot-nix-store.service.614gitlab # [ 3.985683] systemd[1]: Mounting /sysroot/nix/store...615gitlab # [ 4.037566] systemd[1]: Mounted /sysroot/nix/store.616gitlab # [ 4.039860] systemd[1]: Reached target Initrd File Systems.617gitlab # [ 4.041918] systemd[1]: Starting Find NixOS closure...618gitlab # [ 4.043950] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...619gitlab # [ 4.072387] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.620gitlab # [ 4.075177] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.621gitlab # [ 4.094368] systemd[1]: Finished Find NixOS closure.622gitlab # [ 4.096404] systemd[1]: Reached target Initrd Default Target.623gitlab # [ 4.098761] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...624gitlab # [ 4.140538] systemd[1]: Stopped target Initrd Default Target.625gitlab # [ 4.142725] systemd[1]: Stopped target Basic System.626gitlab # [ 4.144567] systemd[1]: Stopped target Initrd Root Device.627gitlab # [ 4.146498] systemd[1]: Stopped target Path Units.628gitlab # [ 4.148159] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.629gitlab # [ 4.150933] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.630gitlab # [ 4.153811] systemd[1]: Stopped target Slice Units.631gitlab # [ 4.156905] systemd[1]: Stopped target Socket Units.632gitlab # [ 4.158992] systemd[1]: Stopped target System Initialization.633gitlab # [ 4.161296] systemd[1]: Stopped target Swaps.634gitlab # [ 4.163291] systemd[1]: Stopped target Timer Units.635gitlab # [ 4.165688] systemd[1]: dbus.socket: Deactivated successfully.636gitlab # [ 4.168256] systemd[1]: Closed D-Bus System Message Bus Socket.637gitlab # [ 4.172347] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.638gitlab # [ 4.175167] systemd[1]: Stopped Find NixOS closure.639gitlab # [ 4.177082] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio640gitlab # [ 4.180901] systemd[1]: Starting rw-sysroot-nix-store.service...641gitlab # [ 4.183563] systemd[1]: systemd-sysctl.service: Deactivated successfully.642gitlab # [ 4.185522] systemd[1]: Stopped Apply Kernel Variables.643gitlab # [ 4.187078] systemd[1]: systemd-modules-load.service: Deactivated successfully.644gitlab # [ 4.189164] systemd[1]: Stopped Load Kernel Modules.645gitlab # [ 4.190615] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.646gitlab # [ 4.192762] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.647gitlab # [ 4.195067] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.648gitlab # [ 4.197361] systemd[1]: Stopped Create System Files and Directories.649gitlab # [ 4.199167] systemd[1]: Stopped target Local File Systems.650gitlab # [ 4.200695] systemd[1]: Stopped target Preparation for Local File Systems.651gitlab # [ 4.202572] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.652gitlab # [ 4.204588] systemd[1]: Stopped Coldplug All udev Devices.653gitlab # [ 4.205813] systemd[1]: Stopping Rule-based Manager for Device Events and Files...654gitlab # [ 4.207207] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.655gitlab # [ 4.208556] systemd[1]: Stopped Virtual Console Setup.656gitlab # [ 4.209585] systemd[1]: initrd-cleanup.service: Deactivated successfully.657gitlab # [ 4.210794] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.658gitlab # [ 4.212099] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.659gitlab # [ 4.213406] systemd[1]: Finished rw-sysroot-nix-store.service.660gitlab # [ 4.214535] systemd[1]: systemd-udevd.service: Deactivated successfully.661gitlab # [ 4.215783] systemd[1]: Stopped Rule-based Manager for Device Events and Files.662gitlab # [ 4.217338] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.663gitlab # [ 4.218652] systemd[1]: Closed udev Control Socket.664gitlab # [ 4.219652] systemd[1]: Starting Cleanup udev Database...665gitlab # [ 4.220735] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.666gitlab # [ 4.222108] systemd[1]: Stopped Create Static Device Nodes in /dev.667gitlab # [ 4.223257] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.668gitlab # [ 4.224392] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.669gitlab # [ 4.225438] systemd[1]: kmod-static-nodes.service: Deactivated successfully.670gitlab # [ 4.226461] systemd[1]: Stopped Create List of Static Device Nodes.671gitlab # [ 4.241348] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.672gitlab # [ 4.242783] systemd[1]: Finished Cleanup udev Database.673gitlab # [ 4.243715] systemd[1]: Reached target Switch Root.674gitlab # [ 4.245850] systemd[1]: Starting NixOS Activation...675gitlab # [ 4.384946] initrd-nixos-activation-start[227]: booting system configuration /nix/store/6qzh9bg13qnkfdl1fqzd2jqgccf4h6w6-nixos-system-gitlab-test676gitlab # [ 4.434396] initrd-nixos-activation-start[227]: running activation script...677gitlab # [ 4.665822] initrd-nixos-activation-start[250]: setting up /etc...678gitlab # [ 4.766048] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.679gitlab # [ 4.768276] systemd[1]: Finished NixOS Activation.680gitlab # [ 4.769822] systemd[1]: Starting Switch Root...681gitlab # [ 4.800641] systemd[1]: Switching root.682gitlab # [ 5.022543] systemd-journald[91]: Received SIGTERM from PID 1 (systemd).683gitlab # [ 5.114556] NET: Registered PF_VSOCK protocol family684gitlab # [ 5.490872] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)685gitlab # [ 5.501130] systemd[1]: Detected virtualization kvm.686gitlab # [ 5.503020] systemd[1]: Detected architecture x86-64.687gitlab # [ 5.505054] systemd[1]: Detected first boot.688gitlab # [ 5.507676] systemd[1]: Initializing machine ID from random generator.689gitlab # [ 5.647414] systemd[1]: bpf-restrict-fs: LSM BPF program attached690gitlab # [ 5.747196] systemd[1]: Applying preset policy.691gitlab # [ 5.897990] systemd[1]: Populated /etc with preset unit settings.692gitlab # [ 6.021894] systemd[1]: initrd-switch-root.service: Deactivated successfully.693gitlab # [ 6.023347] systemd[1]: Stopped initrd-switch-root.service.694gitlab # [ 6.026011] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.695gitlab # [ 6.028161] systemd[1]: Created slice Slice /system/getty.696gitlab # [ 6.029604] systemd[1]: Created slice GitLab DevOps Platform Slice.697gitlab # [ 6.031082] systemd[1]: Created slice User and Session Slice.698gitlab # [ 6.032044] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.699gitlab # [ 6.033356] systemd[1]: Started Forward Password Requests to Wall Directory Watch.700gitlab # [ 6.034556] systemd[1]: Expecting device /dev/hvc0...701gitlab # [ 6.035288] systemd[1]: Expecting device /dev/ttyS0...702gitlab # [ 6.036013] systemd[1]: Reached target Local Encrypted Volumes.703gitlab # [ 6.036942] systemd[1]: Stopped target initrd-fs.target.704gitlab # [ 6.037783] systemd[1]: Stopped target initrd-root-fs.target.705gitlab # [ 6.038662] systemd[1]: Stopped target initrd-switch-root.target.706gitlab # [ 6.039611] systemd[1]: Reached target Virtual Machines and Containers.707gitlab # [ 6.040620] systemd[1]: Reached target Path Units.708gitlab # [ 6.041357] systemd[1]: Reached target Remote File Systems.709gitlab # [ 6.042154] systemd[1]: Reached target Slice Units.710gitlab # [ 6.042902] systemd[1]: Reached target Swaps.711gitlab # [ 6.044467] systemd[1]: Listening on Query the User Interactively for a Password.712gitlab # [ 6.046507] systemd[1]: Listening on Process Core Dump Socket.713gitlab # [ 6.047830] systemd[1]: Listening on Credential Encryption/Decryption.714gitlab # [ 6.049512] systemd[1]: Listening on Factory Reset Management.715gitlab # [ 6.050456] systemd[1]: Listening on Hostname Service Socket.716gitlab # [ 6.052949] systemd[1]: Starting Journal Log Access Socket...717gitlab # [ 6.054552] systemd[1]: Listening on Journal Audit Socket.718gitlab # [ 6.056471] systemd[1]: Listening on Console Output Muting Service Socket.719gitlab # [ 6.057597] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.720gitlab # [ 6.058787] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os721gitlab # [ 6.060160] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki722gitlab # [ 6.062989] systemd[1]: Listening on Disk Repartitioning Service Socket.723gitlab # [ 6.064209] systemd[1]: Listening on udev Control Socket.724gitlab # [ 6.065132] systemd[1]: Listening on udev Varlink Socket.725gitlab # [ 6.068119] systemd[1]: Mounting Huge Pages File System...726gitlab # [ 6.070459] systemd[1]: Mounting POSIX Message Queue File System...727gitlab # [ 6.072702] systemd[1]: Mounting Kernel Debug File System...728gitlab # [ 6.075405] systemd[1]: Mounting Kernel Trace File System...729gitlab # [ 6.087607] systemd[1]: Starting Create List of Static Device Nodes...730gitlab # [ 6.088741] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio731gitlab # [ 6.093681] systemd[1]: Starting Load Kernel Module configfs...732gitlab # [ 6.096380] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm733gitlab # [ 6.098361] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore734gitlab # [ 6.100317] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse735gitlab # [ 6.104334] systemd[1]: Mounting FUSE Control File System...736gitlab # [ 6.105306] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67737gitlab # [ 6.114395] systemd[1]: Starting Journal Service...738gitlab # [ 6.118344] systemd[1]: Starting Load Kernel Modules...739gitlab # [ 6.126205] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...740gitlab # [ 6.135455] systemd[1]: Starting Remount Root and Kernel File Systems...741gitlab # [ 6.137745] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os742gitlab # [ 6.145166] systemd[1]: Starting Coldplug All udev Devices...743gitlab # [ 6.152051] systemd[1]: Listening on Journal Log Access Socket.744gitlab # [ 6.170310] systemd[1]: Mounted Huge Pages File System.745gitlab # [ 6.171351] systemd[1]: Mounted POSIX Message Queue File System.746gitlab # [ 6.172218] loop: module loaded747gitlab # [ 6.172514] systemd[1]: Mounted Kernel Debug File System.748gitlab # [ 6.172963] systemd-journald[322]: Collecting audit messages is enabled.749gitlab # [ 6.173323] systemd[1]: Mounted Kernel Trace File System.750gitlab # [ 6.177511] systemd[1]: Finished Create List of Static Device Nodes.751gitlab # [ 6.178784] systemd[1]: modprobe@configfs.service: Deactivated successfully.752gitlab # [ 6.179958] EXT4-fs (vda): re-mounted fe3e9fab-d053-4de3-82c6-92416d3e2f28.753gitlab # [ 6.180290] systemd[1]: Finished Load Kernel Module configfs.754gitlab # [ 6.183116] systemd[1]: Mounted FUSE Control File System.755gitlab # [ 6.038681] systemd[1]: Queued start job for default target Multi-User System[ 6.184835] systemd[1]: Finished Load Kernel Modules.756gitlab # .757gitlab # [ 6.040722] systemd[1]: Unnecessary job was removed for /dev/[ 6.186810] systemd[1]: Started Journal Service.758gitlab # vdb.759gitlab # [ 6.042519] systemd[1]: systemd-journald.service: Deactivated successfully.760gitlab # [ 6.043843] systemd-modules-load[323]: Using 3 probe threads761gitlab # [ 6.044848] systemd-modules-load[323]: Inserted module 'loop'762gitlab # [ 6.045839] systemd-modules-load[323]: Inserted module 'tls'763gitlab # [ 6.047071] systemd-oomd[324]: No swap; memory pressure usage will be degraded764gitlab # [ 6.048730] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.765gitlab # [ 6.049891] systemd[1]: Finished Remount Root and Kernel File Systems.766gitlab # [ 6.053322] systemd[1]: Listening on Disk Image Download Service Socket.767gitlab # [ 6.054476] systemd[1]: Mounting Kernel Configuration File System...768gitlab # [ 6.055642] systemd[1]: Starting Firewall...769gitlab # [ 6.056438] systemd[1]: Starting Flush Journal to Persistent Storage...770gitlab # [ 6.057524] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore771gitlab # [ 6.062097] systemd[1]: Starting Load/Save OS Random Seed...772gitlab # [ 6.063131] systemd[1]: Starting Apply Kernel Variables...773gitlab # [ 6.210280] systemd-journald[322]: Received client request to flush runtime journal.774gitlab # [ 6.104619] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...775gitlab # [ 6.106083] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os776gitlab # [ 6.110369] systemd[1]: Mounted Kernel Configuration File System.777gitlab # [ 6.112094] systemd[1]: Finished Apply Kernel Variables.778gitlab # [ 6.113205] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.779gitlab # [ 6.114320] systemd[1]: Finished Load/Save OS Random Seed.780gitlab # [ 6.116112] systemd[1]: Reached target First Boot Complete.781gitlab # [ 6.117079] systemd[1]: Starting Create Static Device Nodes in /dev...782gitlab # [ 6.118096] systemd[1]: Finished Flush Journal to Persistent Storage.783gitlab # [ 6.119127] systemd[1]: Finished Create Static Device Nodes in /dev.784gitlab # [ 6.120091] systemd[1]: Reached target Preparation for Local File Systems.785gitlab # [ 6.121092] systemd[1]: Starting Rule-based Manager for Device Events and Files...786gitlab # [ 6.150786] systemd-udevd[360]: Using default interface naming scheme 'v261'.787gitlab # [ 6.180631] systemd[1]: Started Rule-based Manager for Device Events and Files.788gitlab # [ 6.199226] systemd[1]: Finished Coldplug All udev Devices.789gitlab # [ 6.252669] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse790gitlab # [ 6.273509] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.791gitlab # [ 6.316913] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.792gitlab # [ 6.345342] (udev-worker)[416]: Network interface NamePolicy= disabled on kernel command line.793gitlab # [ 6.348304] (udev-worker)[422]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.794gitlab # [ 6.351083] (udev-worker)[422]: Network interface NamePolicy= disabled on kernel command line.795gitlab # [ 6.513692] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3796gitlab # [ 6.519697] ACPI: button: Power Button [PWRF]797gitlab # [ 6.520689] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console798gitlab # [ 6.535056] Console: switching to colour dummy device 80x25799gitlab # [ 6.536484] [drm] Found bochs VGA, ID 0xb0c5.800gitlab # [ 6.537025] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.801gitlab # [ 6.543310] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0802gitlab # [ 6.544178] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD803gitlab # [ 6.551346] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic804gitlab # [ 6.552118] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0805gitlab # [ 6.560652] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input4806gitlab # [ 6.567166] Console: switching to colour frame buffer device 160x50807gitlab # [ 6.569896] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device808gitlab # [ 6.573774] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6809gitlab # [ 6.440399] systemd[1]: Finished Firewall.810gitlab # [ 6.444035] systemd[1]: Condition check resulted in Virtio network device being skipped.811gitlab # [ 6.445471] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore812gitlab # [ 6.447395] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67813gitlab # [ 6.450338] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore814gitlab # [ 6.452167] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os815gitlab # [ 6.453555] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os816gitlab # [ 6.601560] Floppy drive(s): fd0 is 2.88M AMI BIOS817gitlab # [ 6.605914] parport_pc 00:03: reported by Plug and Play ACPI818gitlab # [ 6.606925] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]819gitlab # [ 6.612046] rtc_cmos 00:05: RTC can wake from S4820gitlab # [ 6.614669] FDC 0 is a S82078B821gitlab # [ 6.616148] rtc_cmos 00:05: registered as rtc0822gitlab # [ 6.616980] rtc_cmos 00:05: setting system clock to 2026-09-13T12:05:55 UTC (1789301155)823gitlab # [ 6.618311] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs824gitlab # [ 6.620841] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5825gitlab # [ 6.624288] mousedev: PS/2 mouse device common for all mice826gitlab # [ 6.543222] systemd[1]: Starting Virtual Console Setup...827gitlab # [ 6.555483] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.828gitlab # [ 6.557869] systemd[1]: Stopped Virtual Console Setup.829gitlab # [ 6.570307] systemd[1]: Starting Virtual Console Setup...830gitlab # [ 6.574459] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.831gitlab # [ 6.576501] systemd[1]: Stopped Virtual Console Setup.832gitlab # [ 6.581214] systemd[1]: Starting Virtual Cons[ 6.727837] ppdev: user-space parallel port driver833gitlab # ole Setup...834gitlab # [ 6.749721] kvm_amd: TSC scaling supported835gitlab # [ 6.750557] kvm_amd: Nested Virtualization enabled836gitlab # [ 6.751208] kvm_amd: Nested Paging enabled837gitlab # [ 6.751834] kvm_amd: LBR virtualization supported838gitlab # [ 6.752576] kvm_amd: Virtual VMLOAD VMSAVE supported839gitlab # [ 6.753233] kvm_amd: Virtual GIF supported840gitlab # [ 6.753882] kvm_amd: Virtual NMI enabled841gitlab # [ 6.787573] EDAC MC: Ver: 3.0.0842gitlab # [ 6.646951] systemd-vconsole-setup[495]: Configuration of first virtual console was skipped, ignoring remaining ones.843gitlab # [ 6.649604] systemd[1]: Finished Virtual Console Setup.844gitlab # [ 6.881098] systemd[1]: Mounting /run/wrappers...845gitlab # [ 6.906875] systemd[1]: Mounted /run/wrappers.846gitlab # [ 6.908969] systemd[1]: Reached target Local File Systems.847gitlab # [ 6.910917] systemd[1]: Listening on Boot Loader Control Service Socket.848gitlab # [ 6.913663] systemd[1]: Starting register-nix-paths.service...849gitlab # [ 6.916299] systemd[1]: Starting Create SUID/SGID Wrappers...850gitlab # [ 6.918578] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.851gitlab # [ 6.921656] systemd[1]: Starting Save Transient machine-id to Disk...852gitlab # [ 6.924170] systemd[1]: Starting Create System Files and Directories...853gitlab # [ 6.964815] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.854gitlab # [ 6.971289] systemd[1]: Finished Save Transient machine-id to Disk.855gitlab # [ 6.976509] systemd[1]: Finished Create System Files and Directories.856gitlab # [ 6.981180] systemd[1]: Starting Rebuild Journal Catalog...857gitlab # [ 6.984218] systemd[1]: Starting Record System Boot/Shutdown in UTMP...858gitlab # [ 7.000509] systemd[1]: Finished Record System Boot/Shutdown in UTMP.859gitlab # [ 7.017650] systemd[1]: Finished Rebuild Journal Catalog.860gitlab # [ 7.019323] systemd[1]: Starting Update is Completed...861gitlab # [ 7.037314] systemd[1]: Finished Update is Completed.862gitlab # [ 7.088931] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.863gitlab # [ 7.090950] systemd[1]: Finished Create SUID/SGID Wrappers.864gitlab # [ 7.310358] systemd[1]: Finished register-nix-paths.service.865gitlab # [ 7.312642] systemd[1]: Reached target System Initialization.866gitlab # [ 7.314633] systemd[1]: Started Discard unused filesystem blocks once a week.867gitlab # [ 7.317114] systemd[1]: Started logrotate.timer.868gitlab # [ 7.318862] systemd[1]: Started Daily Cleanup of Temporary Directories.869gitlab # [ 7.321144] systemd[1]: Reached target Timer Units.870gitlab # [ 7.322927] systemd[1]: Listening on D-Bus System Message Bus Socket.871gitlab # [ 7.325164] systemd[1]: Listening on Nix Daemon Socket.872gitlab # [ 7.326971] systemd[1]: Starting nixbot CI service socket...873gitlab # [ 7.329069] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.874gitlab # [ 7.331850] systemd[1]: Starting D-Bus System Message Bus...875gitlab # [ 7.334982] systemd[1]: Listening on nixbot CI service socket.876gitlab # [ 7.337102] systemd[1]: Reached target Socket Units.877gitlab # [ 7.402692] dbus-broker-launch[577]: Looking up NSS user entry for 'systemd-timesync'...878gitlab # [ 7.406063] dbus-broker-launch[577]: NSS returned no entry for 'systemd-timesync'879gitlab # [ 7.408819] dbus-broker-launch[577]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"880gitlab # [ 7.413987] systemd[1]: Started D-Bus System Message Bus.881gitlab # [ 7.437535] dbus-broker-launch[577]: Ready882gitlab # [ 7.440430] systemd[1]: Reached target Basic System.883gitlab # [ 7.443720] systemd[1]: Started backdoor.service.884gitlab # [ 7.446657] systemd[1]: Starting gitlab-config.service...885gitlab # [ 7.449971] systemd[1]: Starting Import lastlog data into lastlog2 database...886gitlab # [ 7.464656] systemd[1]: Starting Logrotate configuration check...887gitlab # [ 7.472809] systemd[1]: Starting Name Service Cache Daemon (nsncd)...888gitlab # [ 7.480649] systemd[1]: Starting Post-Boot Actions...889gitlab # [ 7.487447] systemd[1]: Started Reset console on configuration changes.890gitlab # connecting to host...891gitlab # [ 7.494506] systemd[1]: Starting resolvconf update...892gitlab # [ 7.498209] logrotate[582]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.893gitlab # [ 7.502295] logrotate[582]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf894gitlab # [ 7.505562] logrotate[582]: note: 'monthly' overrides previously specified 'weekly'895gitlab # [ 7.508213] logrotate[582]: Reading state from file: /var/lib/logrotate.status896gitlab # [ 7.513822] logrotate[582]: state file /var/lib/logrotate.status does not exist897gitlab: Guest shell says: b'Spawning backdoor root shell...\n'898gitlab # [ 7.515073] logrotate[582]: Allocating hash table for state file, size 64 entries899gitlab # [ 7.516259] logrotate[582]: Handling 4 logs900gitlab: connected to guest root shell901gitlab # [ 7.516823] logrotate[582]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed902gitlab: (connecting took 8.12 seconds)903gitlab # [ 7.519076] logrotate[582]: considering log /var/log/btmp904gitlab: (finished: waiting for the VM to finish booting, in 8.12 seconds)905gitlab # [ 7.519834] logrotate[582]: Creating new state906gitlab # [ 7.520640] logrotate[582]: Now: 2026-09-13 12:05907gitlab # [ 7.521282] logrotate[582]: Last rotated at 2026-09-13 12:00908gitlab # [ 7.521818] logrotate[582]: log does not need rotating (log has already been rotated)909gitlab # [ 7.522564] logrotate[582]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed910gitlab # [ 7.522941] logrotate[582]: considering log /var/log/wtmp911gitlab # [ 7.523576] logrotate[582]: Creating new state912gitlab # [ 7.524070] logrotate[582]: Now: 2026-09-13 12:05913gitlab # [ 7.524530] logrotate[582]: Last rotated at 2026-09-13 12:00914gitlab # [ 7.525096] logrotate[582]: log does not need rotating (log has already been rotated)915gitlab # [ 7.525625] logrotate[582]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed916gitlab # [ 7.526110] logrotate[582]: switching euid from 0 to 165 and egid from 0 to 165 (pid 582)917gitlab # [ 7.526551] logrotate[582]: considering log /var/gitlab/state/log/*.log918gitlab # [ 7.527152] logrotate[582]: log /var/gitlab/state/log/*.log does not exist -- skipping919gitlab # [ 7.527689] logrotate[582]: Creating new state920gitlab # [ 7.528580] logrotate[582]: switching euid from 165 to 0 and egid from 165 to 0 (pid 582)921gitlab # [ 7.529347] logrotate[582]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed922gitlab # [ 7.530092] logrotate[582]: switching euid from 0 to 60 and egid from 0 to 60 (pid 582)923gitlab # [ 7.530423] logrotate[582]: considering log /var/log/nginx/*.log924gitlab # [ 7.530605] logrotate[582]: log /var/log/nginx/*.log does not exist -- skipping925gitlab # [ 7.531263] logrotate[582]: Creating new state926gitlab # [ 7.531751] logrotate[582]: not running postrotate script, since no logs were rotated927gitlab # [ 7.532461] logrotate[582]: switching euid from 60 to 0 and egid from 60 to 0 (pid 582)928gitlab # [ 7.533199] systemd[1]: Finished Logrotate configuration check.929gitlab # [ 7.534463] systemd[1]: Finished Post-Boot Actions.930gitlab # [ 7.535587] systemd[1]: Finished Import lastlog data into lastlog2 database.931gitlab # [ 7.536319] nsncd[583]: Sep 13 12:05:56.556 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"932gitlab # [ 7.537260] systemd[1]: Started Name Service Cache Daemon (nsncd).933gitlab # [ 7.537989] systemd[1]: Reached target Host and Network Name Lookups.934gitlab # [ 7.539327] systemd[1]: Reached target User and Group Name Lookups.935gitlab # [ 7.540673] systemd[1]: Starting User Login Management...936gitlab # [ 7.585236] systemd-logind[621]: New seat seat0.937gitlab # [ 7.587835] systemd-logind[621]: Watching system buttons on /dev/input/event2 (Power Button)938gitlab # [ 7.589142] systemd-logind[621]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)939gitlab # [ 7.590376] systemd-logind[621]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)940gitlab # [ 7.591698] systemd[1]: Started User Login Management.941gitlab # [ 7.592514] systemd[1]: Starting linger-users.service...942gitlab # [ 7.600472] systemd[1]: Stopped target Host and Network Name Lookups.943gitlab # [ 7.601329] systemd[1]: Stopping Host and Network Name Lookups...944gitlab # [ 7.602169] systemd[1]: Stopped target User and Group Name Lookups.945gitlab # [ 7.602639] systemd[1]: Stopping User and Group Name Lookups...946gitlab # [ 7.603000] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...947gitlab # [ 7.603990] systemd[1]: nscd.service: Deactivated successfully.948gitlab # [ 7.606112] systemd[1]: Stopped Name Service Cache Daemon (nsncd).949gitlab # [ 7.607181] systemd[1]: nscd.service: Consumed 24ms CPU time over 131ms wall clock time, 7M memory peak, 5.5M read from disk.950gitlab # [ 7.615684] systemd[1]: Starting Name Service Cache Daemon (nsncd)...951gitlab # [ 7.616667] systemd[1]: linger-users.service: Deactivated successfully.952gitlab # [ 7.620618] systemd[1]: Finished linger-users.service.953gitlab # [ 7.630687] systemd[1]: Started Name Service Cache Daemon (nsncd).954gitlab # [ 7.631847] systemd[1]: Reached target Host and Network Name Lookups.955gitlab # [ 7.633047] systemd[1]: Reached target User and Group Name Lookups.956gitlab # [ 7.633994] nsncd[676]: Sep 13 12:05:56.659 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"957gitlab # [ 7.639109] systemd[1]: Finished resolvconf update.958gitlab # [ 7.640240] systemd[1]: Reached target Preparation for Network.959gitlab # [ 7.643272] systemd[1]: Starting DHCP Client...960gitlab # [ 7.645529] systemd[1]: Starting Address configuration of eth1...961gitlab # [ 7.649428] systemd[1]: Starting Extra networking commands....962gitlab # [ 7.682252] network-addresses-eth1-start[700]: adding address 192.168.1.1/24... done963gitlab # [ 7.685089] network-addresses-eth1-start[700]: adding address 2001:db8:1::1/64... done964gitlab # [ 7.691452] systemd[1]: Finished Address configuration of eth1.965gitlab # [ 7.717234] dhcpcd[707]: dhcpcd-10.3.2 starting966gitlab # [ 7.720031] dhcpcd[763]: dev: loaded udev967gitlab # [ 7.723689] systemd[1]: Finished Extra networking commands..968gitlab # [ 7.725168] systemd[1]: Reached target Network.969gitlab # [ 7.872447] 8021q: 802.1Q VLAN Support v1.8970gitlab # [ 7.872973] 8021q: adding VLAN 0 to HW filter on device eth1971gitlab # [ 7.727376] systemd[1]: Starting gitlab-workhorse.service...972gitlab # [ 7.731690] systemd[1]: Starting Nginx Web Server...973gitlab # [ 7.737891] systemd[1]: Starting PostgreSQL Server...974gitlab # [ 7.739118] systemd[1]: Starting Redis Server - redis-gitlab...975gitlab # [ 7.741285] systemd[1]: Starting Permit User Sessions...976gitlab # [ 7.746604] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.977gitlab # [ 7.759692] systemd[1]: Finished Permit User Sessions.978gitlab # [ 7.768091] systemd[1]: Started Getty on tty1.979gitlab # [ 7.770171] systemd[1]: Reached target Login Prompts.980gitlab # [ 7.960284] cfg80211: Loading compiled-in X.509 certificates for regulatory database981gitlab # [ 7.966629] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'982gitlab # [ 7.967864] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'983gitlab # [ 7.970761] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2984gitlab # [ 7.972141] cfg80211: failed to load regulatory.db985gitlab # [ 7.999026] 8021q: adding VLAN 0 to HW filter on device eth0986gitlab # [ 7.855850] dhcpcd[763]: eth0: waiting for carrier987gitlab # [ 7.856928] dhcpcd[763]: eth0: carrier acquired988gitlab # [ 7.860298] dhcpcd[763]: DUID 00:01:00:01:32:39:4e:24:52:54:00:12:34:56989gitlab # [ 7.861405] dhcpcd[763]: eth0: IAID 00:12:34:56990gitlab # [ 7.862128] dhcpcd[763]: eth0: adding address fe80::5054:ff:fe12:3456991gitlab # [ 7.875329] nginx-pre-start[789]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok992gitlab # [ 7.877147] nginx-pre-start[789]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful993gitlab # [ 7.880572] systemd[1]: Started Nginx Web Server.994gitlab # [ 7.892762] redis-server[790]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.995gitlab # [ 7.896058] redis-server[790]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo996gitlab # [ 7.897263] redis-server[790]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=790, just started997gitlab # [ 7.898934] redis-server[790]: Configuration loaded998gitlab # [ 7.900054] redis[790]: monotonic clock: POSIX clock_gettime999gitlab # [ 7.901109] redis[790]: Running mode=standalone, port=0.1000gitlab # [ 7.902546] systemd[1]: Started Redis Server - redis-gitlab.1001gitlab # [ 7.903930] postgresql-pre-start[795]: The files belonging to this database system will be owned by user "postgres".1002gitlab # [ 7.905762] postgresql-pre-start[795]: This user must also own the server process.1003gitlab # [ 7.907035] redis[790]: Server initialized1004gitlab # [ 7.907979] postgresql-pre-start[795]: The database cluster will be initialized with locale "en_US.UTF-8".1005gitlab # [ 7.909491] postgresql-pre-start[795]: The default database encoding has accordingly been set to "UTF8".1006gitlab # [ 7.910922] postgresql-pre-start[795]: The default text search configuration will be set to "english".1007gitlab # [ 7.912536] postgresql-pre-start[795]: Data page checksums are enabled.1008gitlab # [ 7.913695] postgresql-pre-start[795]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok1009gitlab # [ 7.914989] postgresql-pre-start[795]: creating subdirectories ... ok1010gitlab # [ 7.915932] postgresql-pre-start[795]: selecting dynamic shared memory implementation ... posix1011gitlab # [ 7.917341] redis[790]: Ready to accept connections unix1012gitlab # [ 7.918595] redis[790]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1013gitlab # [ 7.941744] postgresql-pre-start[795]: selecting default "max_connections" ... 1001014gitlab # [ 7.988271] postgresql-pre-start[795]: selecting default "shared_buffers" ... 128MB1015gitlab # [ 8.227859] systemd[1]: Started gitlab-workhorse.service.1016gitlab # [ 8.367312] postgresql-pre-start[795]: selecting default time zone ... UTC1017gitlab # [ 8.370386] postgresql-pre-start[795]: creating configuration files ... ok1018gitlab # [ 8.447660] gitlab-workhorse[825]: time="2026-09-13T12:05:57Z" level=info msg=Starting build_time=19700101.000000 version=19.0.41019gitlab # [ 8.451747] gitlab-workhorse[825]: time="2026-09-13T12:05:57Z" level=info msg="Using redis/go-redis"1020gitlab # [ 8.454993] gitlab-workhorse[825]: time="2026-09-13T12:05:57Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1021gitlab # [ 8.541814] postgresql-pre-start[795]: running bootstrap script ... ok1022gitlab # [ 8.984389] postgresql-pre-start[795]: performing post-bootstrap initialization ... ok1023gitlab # [ 9.301195] postgresql-pre-start[795]: syncing data to disk ... ok1024gitlab # [ 9.302365] postgresql-pre-start[795]: initdb: warning: enabling "trust" authentication for local connections1025gitlab # [ 9.303330] postgresql-pre-start[795]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1026gitlab # [ 9.304097] postgresql-pre-start[795]: Success. You can now start the database server using:1027gitlab # [ 9.304780] postgresql-pre-start[795]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1028gitlab # [ 9.406734] postgres[851]: [851] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1029gitlab # [ 9.411333] postgres[851]: [851] LOG: listening on IPv6 address "::1", port 54321030gitlab # [ 9.412818] postgres[851]: [851] LOG: listening on IPv4 address "127.0.0.1", port 54321031gitlab # [ 9.420074] postgres[851]: [851] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1032gitlab # [ 9.434094] postgres[864]: [864] LOG: database system was shut down at 2026-09-13 12:05:58 GMT1033gitlab # [ 9.442052] postgres[851]: [851] LOG: database system is ready to accept connections1034gitlab # [ 9.447456] systemd[1]: Started PostgreSQL Server.1035gitlab # [ 9.451725] systemd[1]: Starting PostgreSQL Setup Scripts...1036gitlab # [ 9.479880] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[854]: mkdir -p /var/gitlab/state/home/.ssh: OK1037gitlab # [ 9.482823] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[854]: chmod 700 /var/gitlab/state/home/.ssh: OK1038gitlab # [ 9.554388] systemd[1]: Finished gitlab-config.service.1039gitlab # [ 9.558933] systemd[1]: Started gitaly.service.1040gitlab # [ 9.610116] postgresql-setup-start[881]: CREATE DATABASE1041gitlab # [ 9.632603] postgresql-setup-start[898]: CREATE ROLE1042gitlab # [ 9.641095] postgresql-setup-start[905]: ALTER DATABASE1043gitlab # [ 9.657942] postgresql-setup-start[910]: CREATE ROLE1044gitlab # [ 9.660696] systemd[1]: Finished PostgreSQL Setup Scripts.1045gitlab # [ 9.661473] systemd[1]: Reached target PostgreSQL.1046gitlab # [ 9.663253] systemd[1]: Starting gitlab-db-config.service...1047gitlab # [ 9.665419] systemd[1]: Starting gitlab-postgresql.service...1048gitlab # [ 9.767648] gitlab-postgresql-start[920]: CREATE DATABASE1049gitlab # [ 9.770132] dhcpcd[763]: eth0: soliciting a DHCP lease1050gitlab # [ 9.926089] NET: Registered PF_PACKET protocol family1051gitlab # [ 9.788686] dhcpcd[763]: eth0: offered 10.0.2.15 from 10.0.2.21052gitlab # [ 9.792639] dhcpcd[763]: eth0: probing address 10.0.2.15/241053gitlab # [ 9.808068] gitlab-postgresql-start[932]: CREATE EXTENSION1054gitlab # [ 9.881433] gitlab-postgresql-start[934]: CREATE EXTENSION1055gitlab # [ 9.885818] systemd[1]: Finished gitlab-postgresql.service.1056gitlab # [ 10.084120] gitaly[889]: time="2026-09-13T12:05:59.112Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=8891057gitlab # [ 10.085248] gitaly[889]: time="2026-09-13T12:05:59.112Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=8891058gitlab # [ 10.085920] gitaly[889]: time="2026-09-13T12:05:59.112Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=8891059gitlab # [ 10.086703] gitaly[889]: time="2026-09-13T12:05:59.112Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=8891060gitlab # [ 10.087453] gitaly[889]: time="2026-09-13T12:05:59.112Z" level=info msg="Starting Gitaly" pid=889 version=1061gitlab # [ 10.234472] dhcpcd[763]: eth0: soliciting an IPv6 router1062gitlab # [ 10.235816] dhcpcd[763]: eth0: Router Advertisement from fe80::21063gitlab # [ 10.236755] dhcpcd[763]: eth0: adding address fec0::5054:ff:fe12:3456/641064gitlab # [ 10.237704] dhcpcd[763]: eth0: adding route to fec0::/641065gitlab # [ 10.238507] dhcpcd[763]: eth0: adding default route via fe80::21066gitlab # [ 10.261077] gitaly[889]: time="2026-09-13T12:05:59.289Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=176 pid=8891067gitlab # [ 10.262729] gitaly[889]: time="2026-09-13T12:05:59.290Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=8891068gitlab # [ 10.264132] gitaly[889]: time="2026-09-13T12:05:59.290Z" level=info msg="finished initializing command factory" duration_ms=0 pid=8891069gitlab # [ 10.265647] gitaly[889]: time="2026-09-13T12:05:59.290Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-889/git-exec-1000554506.d/git pid=8891070gitlab # [ 10.271068] gitaly[889]: time="2026-09-13T12:05:59.300Z" level=info msg="finished detecting git version" duration_ms=9 pid=8891071gitlab # [ 10.273685] gitaly[889]: time="2026-09-13T12:05:59.301Z" level=info msg="using Git version" pid=889 version=2.53.g1072gitlab # [ 10.275335] gitaly[889]: time="2026-09-13T12:05:59.302Z" level=info msg="clearing disk cache object folder" pid=889 storage=default1073gitlab # [ 10.277240] gitaly[889]: time="2026-09-13T12:05:59.302Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache704163387 pid=889 storage=default1074gitlab # [ 10.280345] gitaly[889]: time="2026-09-13T12:05:59.302Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache704163387 pid=889 storage=default1075gitlab # [ 10.280935] gitaly[889]: time="2026-09-13T12:05:59.302Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=8891076gitlab # [ 10.281680] gitaly[889]: time="2026-09-13T12:05:59.302Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=8891077gitlab # [ 10.282502] gitaly[889]: time="2026-09-13T12:05:59.302Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache704163387 clear_duration_ms=0 pid=889 storage=default1078gitlab # [ 10.320112] gitaly[889]: time="2026-09-13T12:05:59.349Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=8891079gitlab # [ 10.320907] gitaly[889]: time="2026-09-13T12:05:59.349Z" level=info msg="counting repositories" pid=8891080gitlab # [ 10.321794] gitaly[889]: time="2026-09-13T12:05:59.349Z" level=info msg="finished tempdir cleaner walk" pid=889 storage=default time_ms=01081gitlab # [ 10.322023] gitaly[889]: time="2026-09-13T12:05:59.349Z" level=info msg="starting to count repositories" pid=889 storage_path=/var/gitlab/state/repositories1082gitlab # [ 10.323226] gitaly[889]: time="2026-09-13T12:05:59.349Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=889 schema=unix1083gitlab # [ 10.323561] gitaly[889]: time="2026-09-13T12:05:59.349Z" level=info msg="listening at address" address=/run/gitaly/gitaly-889/sock.d/intern pid=889 schema=unix1084gitlab # [ 10.324160] gitaly[889]: time="2026-09-13T12:05:59.350Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=889 storage_path=/var/gitlab/state/repositories1085gitlab # [ 10.324779] gitaly[889]: time="2026-09-13T12:05:59.350Z" level=info msg="completed counting all repositories" counting_duration=0 pid=8891086gitlab # [ 10.325607] gitaly[889]: time="2026-09-13T12:05:59.351Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=8891087gitlab # [ 10.326253] gitaly[889]: time="2026-09-13T12:05:59.351Z" level=info msg="Started Gitaly" duration_ms=238 pid=8891088gitlab # [ 10.326882] gitaly[889]: time="2026-09-13T12:05:59.351Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=8891089gitlab # [ 10.327794] gitaly[889]: time="2026-09-13T12:05:59.352Z" level=info msg="maintenance: daily scheduled" pid=889 scheduled="2026-09-14 12:00:00 +0000 UTC"1090gitlab # [ 11.023504] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[915]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1091gitlab # [ 11.025950] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[915]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1092gitlab # [ 11.045793] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[915]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1093gitlab # [ 12.358608] gitaly[889]: time="2026-09-13T12:06:01.386Z" level=info msg="License database preloaded" duration_ms=2273 pid=8891094gitlab # [ 14.988687] dhcpcd[763]: eth0: leased 10.0.2.15 for 86400 seconds1095gitlab # [ 14.990780] dhcpcd[763]: eth0: adding route to 10.0.2.0/241096gitlab # [ 14.992204] dhcpcd[763]: eth0: adding default route via 10.0.2.21097gitlab # [ 15.119839] systemd[1]: Started DHCP Client.1098gitlab # [ 15.123717] systemd[1]: Reached target Network is Online.1099gitlab # [ 40.811928] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[915]: W, [2026-09-13T12:06:29.840244 #915] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1100gitlab # [ 42.780235] postgres[1308]: [1308] ERROR: relation "feature_gates" does not exist at character 5231101gitlab # [ 42.782580] postgres[1308]: [1308] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1102gitlab # [ 42.783985] postgres[1308]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1103gitlab # [ 42.785878] postgres[1308]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1104gitlab # [ 42.788235] postgres[1308]: attidentity AS identity,1105gitlab # [ 42.790103] postgres[1308]: attgenerated as attgenerated1106gitlab # [ 42.791990] postgres[1308]: FROM pg_attribute a1107gitlab # [ 42.793905] postgres[1308]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1108gitlab # [ 42.796256] postgres[1308]: LEFT JOIN pg_type t ON a.atttypid = t.oid1109gitlab # [ 42.798136] postgres[1308]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1110gitlab # [ 42.799992] postgres[1308]: WHERE a.attrelid = '"feature_gates"'::regclass1111gitlab # [ 42.801913] postgres[1308]: AND a.attnum > 0 AND NOT a.attisdropped1112gitlab # [ 42.804211] postgres[1308]: ORDER BY a.attnum1113gitlab # [ 42.806082] postgres[1308]:1114gitlab # [ 46.156951] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1341]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1115gitlab # [ 46.157847] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1341]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1116gitlab # [ 48.518387] gitlab-workhorse[825]: time="2026-09-13T12:06:37Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1117gitlab # [ 58.528369] gitlab-workhorse[825]: time="2026-09-13T12:06:47Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1118gitlab # [ 61.351345] postgres[1416]: [1416] ERROR: relation "table_without_models" does not exist1119gitlab # [ 61.352611] postgres[1416]: [1416] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1120gitlab # [ 68.537248] gitlab-workhorse[825]: time="2026-09-13T12:06:57Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1121gitlab # [ 73.138477] systemd[1]: Finished gitlab-db-config.service.1122gitlab # [ 73.144165] systemd[1]: Started gitlab-sidekiq.service.1123gitlab # [ 73.148451] systemd[1]: Starting gitlab.service...1124gitlab # [ 73.493784] bundle[1583]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1125gitlab # [ 73.495533] bundle[1583]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1126gitlab # [ 73.497312] bundle[1583]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1127gitlab # [ 76.229924] sidekiq-cluster[1582]: {"severity":"INFO","time":"2026-09-13T12:07:05.241Z","message":"Starting cluster with 1 processes"}1128gitlab # [ 76.317792] bundle[1583]: {"timestamp":"2026-09-13T12:07:05.326Z","pid":1583,"message":"* Enabling systemd notification integration"}1129gitlab # [ 76.318998] bundle[1583]: {"timestamp":"2026-09-13T12:07:05.346Z","pid":1583,"message":"Puma starting in cluster mode..."}1130gitlab # [ 76.319851] bundle[1583]: {"timestamp":"2026-09-13T12:07:05.346Z","pid":1583,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1131gitlab # [ 76.320771] bundle[1583]: {"timestamp":"2026-09-13T12:07:05.346Z","pid":1583,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1132gitlab # [ 76.321582] bundle[1583]: {"timestamp":"2026-09-13T12:07:05.346Z","pid":1583,"message":"* Min threads: 0"}1133gitlab # [ 76.322320] bundle[1583]: {"timestamp":"2026-09-13T12:07:05.346Z","pid":1583,"message":"* Max threads: 4"}1134gitlab # [ 76.323129] bundle[1583]: {"timestamp":"2026-09-13T12:07:05.346Z","pid":1583,"message":"* Environment: production"}1135gitlab # [ 76.323925] bundle[1583]: {"timestamp":"2026-09-13T12:07:05.346Z","pid":1583,"message":"* Master PID: 1583"}1136gitlab # [ 76.324641] bundle[1583]: {"timestamp":"2026-09-13T12:07:05.346Z","pid":1583,"message":"* Workers: 2"}1137gitlab # [ 76.325361] bundle[1583]: {"timestamp":"2026-09-13T12:07:05.346Z","pid":1583,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1138gitlab # [ 76.326147] bundle[1583]: {"timestamp":"2026-09-13T12:07:05.346Z","pid":1583,"message":"* Preloading application"}1139gitlab # [ 78.547489] gitlab-workhorse[825]: time="2026-09-13T12:07:07Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1140gitlab # [ 88.551183] gitlab-workhorse[825]: time="2026-09-13T12:07:17Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1141gitlab # [ 98.562401] gitlab-workhorse[825]: time="2026-09-13T12:07:27Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1142gitlab # [ 99.162448] bundle[1583]: W, [2026-09-13T12:07:28.190704 #1583] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1143gitlab # [ 101.400843] sidekiq-cluster[1613]: 2026-09-13T12:07:30.428Z pid=1613 tid=wkl INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1613, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>432963584}1144gitlab # [ 101.586446] sidekiq-cluster[1613]: W, [2026-09-13T12:07:30.615356 #1613] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1145gitlab # [ 101.630254] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:30.659Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1146gitlab # [ 103.680643] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.708Z","message":"GitLab reliable fetch activated!"}1147gitlab # [ 103.681892] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.708Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1148gitlab # [ 103.710407] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.739Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1149gitlab # [ 103.715160] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.744Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1150gitlab # [ 103.719954] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.749Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1151gitlab # [ 103.724645] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.753Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1152gitlab # [ 103.729662] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.758Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1153gitlab # [ 103.735064] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.763Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1154gitlab # [ 103.740235] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.769Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1155gitlab # [ 103.747429] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.776Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1156gitlab # [ 103.752724] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.781Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1157gitlab # [ 103.757367] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.786Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1158gitlab # [ 103.761744] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.790Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1159gitlab # [ 103.767718] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.796Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1160gitlab # [ 103.772459] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.801Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1161gitlab # [ 103.777142] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.806Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1162gitlab # [ 103.782288] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.811Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1163gitlab # [ 103.787460] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.816Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1164gitlab # [ 103.793465] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.822Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1165gitlab # [ 103.799302] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.828Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1166gitlab # [ 103.804854] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.833Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1167gitlab # [ 103.810074] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.839Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1168gitlab # [ 103.814945] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.844Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1169gitlab # [ 103.818900] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.848Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1170gitlab # [ 103.822868] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.851Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1171gitlab # [ 103.827217] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.856Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1172gitlab # [ 103.831894] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.861Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1173gitlab # [ 103.835454] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.864Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1174gitlab # [ 103.839054] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.868Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1175gitlab # [ 103.842508] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.871Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1176gitlab # [ 103.846325] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.875Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1177gitlab # [ 103.849468] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.878Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1178gitlab # [ 103.853091] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.882Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1179gitlab # [ 103.856343] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.885Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1180gitlab # [ 103.859435] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.888Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1181gitlab # [ 103.862298] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.891Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1182gitlab # [ 103.865423] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.894Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1183gitlab # [ 103.868277] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.897Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1184gitlab # [ 103.871300] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.900Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1185gitlab # [ 103.874246] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.903Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1186gitlab # [ 103.876942] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.906Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1187gitlab # [ 103.879733] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.908Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1188gitlab # [ 103.882630] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.911Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1189gitlab # [ 103.885497] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.914Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1190gitlab # [ 103.887645] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.916Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1191gitlab # [ 103.890056] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.919Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1192gitlab # [ 103.892643] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.921Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1193gitlab # [ 103.895218] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.924Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1194gitlab # [ 103.897260] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.926Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1195gitlab # [ 103.899707] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.928Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1196gitlab # [ 103.902140] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.931Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1197gitlab # [ 103.904494] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.933Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1198gitlab # [ 103.907046] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.936Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1199gitlab # [ 103.909875] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.939Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1200gitlab # [ 103.920249] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.949Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1201gitlab # [ 103.923054] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.952Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1202gitlab # [ 103.925751] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.954Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1203gitlab # [ 103.928159] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.957Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1204gitlab # [ 103.930592] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.959Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1205gitlab # [ 103.933527] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.962Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1206gitlab # [ 103.935667] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.964Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1207gitlab # [ 103.938030] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.967Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1208gitlab # [ 103.940590] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.969Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1209gitlab # [ 103.942657] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.971Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1210gitlab # [ 103.945172] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.974Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1211gitlab # [ 103.948077] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.977Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1212gitlab # [ 103.950551] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.979Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1213gitlab # [ 103.953528] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.982Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1214gitlab # [ 103.955673] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.984Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1215gitlab # [ 103.957907] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:32.987Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1216gitlab # [ 103.997141] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.026Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1217gitlab # [ 103.999283] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.028Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1218gitlab # [ 104.001598] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.030Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1219gitlab # [ 104.004044] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.033Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1220gitlab # [ 104.007400] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.036Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1221gitlab # [ 104.009940] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.039Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1222gitlab # [ 104.012667] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.041Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1223gitlab # [ 104.015885] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.045Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1224gitlab # [ 104.018549] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.047Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1225gitlab # [ 104.021774] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.050Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1226gitlab # [ 104.024278] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.053Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1227gitlab # [ 104.026561] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.055Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1228gitlab # [ 104.028406] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.057Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1229gitlab # [ 104.030740] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.059Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1230gitlab # [ 104.033649] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.062Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1231gitlab # [ 104.036064] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.065Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1232gitlab # [ 104.038261] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.067Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1233gitlab # [ 104.040919] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.070Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1234gitlab # [ 104.043372] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.072Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1235gitlab # [ 104.045647] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.074Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1236gitlab # [ 104.047546] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.076Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1237gitlab # [ 104.050038] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.079Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1238gitlab # [ 104.051955] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.081Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1239gitlab # [ 104.054211] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.083Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1240gitlab # [ 104.056110] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.085Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1241gitlab # [ 104.058110] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.087Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1242gitlab # [ 104.060821] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.090Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1243gitlab # [ 104.063775] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.092Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1244gitlab # [ 104.065668] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.094Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1245gitlab # [ 104.068403] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.097Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1246gitlab # [ 104.076231] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.105Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1247gitlab # [ 104.078275] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.107Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1248gitlab # [ 104.080379] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.109Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1249gitlab # [ 104.083262] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.112Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1250gitlab # [ 104.085998] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.115Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1251gitlab # [ 104.088463] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.117Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1252gitlab # [ 104.091122] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.120Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1253gitlab # [ 104.093092] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.122Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1254gitlab # [ 104.095403] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.124Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1255gitlab # [ 104.097978] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.127Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1256gitlab # [ 104.099951] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:07:33.129Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1257gitlab # [ 108.572812] gitlab-workhorse[825]: time="2026-09-13T12:07:37Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1258gitlab # [ 118.582810] gitlab-workhorse[825]: time="2026-09-13T12:07:47Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1259gitlab # [ 128.584537] gitlab-workhorse[825]: time="2026-09-13T12:07:57Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1260gitlab # [ 129.833611] postgres[2060]: [2060] ERROR: relation "table_without_models" does not exist1261gitlab # [ 129.834257] postgres[2060]: [2060] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1262gitlab # [ 129.979963] postgres[2070]: [2070] ERROR: relation "table_without_models" does not exist1263gitlab # [ 129.980608] postgres[2070]: [2070] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1264gitlab # [ 132.408594] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:01.437Z","message":"Booted Rails 7.2.3.1 application in production environment"}1265gitlab # [ 132.411912] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:01.440Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1266gitlab # [ 132.412577] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:01.440Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1267gitlab # [ 132.413319] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:01.440Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1268gitlab # [ 132.418050] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:01.447Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1269gitlab # [ 132.905132] bundle[1583]: {"timestamp":"2026-09-13T12:08:01.933Z","pid":1583,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1270gitlab # [ 132.905927] bundle[1583]: {"timestamp":"2026-09-13T12:08:01.933Z","pid":1583,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1271gitlab # [ 132.907257] bundle[1583]: {"timestamp":"2026-09-13T12:08:01.933Z","pid":1583,"message":"! #\u003cThread:0x00007988a26ebc08 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1272gitlab # [ 132.910804] bundle[1583]: {"timestamp":"2026-09-13T12:08:01.933Z","pid":1583,"message":"! #\u003cThread:0x00007988a28d00a0 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1273gitlab # [ 132.911923] bundle[1583]: {"timestamp":"2026-09-13T12:08:01.933Z","pid":1583,"message":"Use Ctrl-C to stop"}1274gitlab # [ 132.913091] bundle[1583]: {"timestamp":"2026-09-13T12:08:01.934Z","pid":1583,"message":"Sending status to systemd every 1.0 sec"}1275gitlab # [ 133.665258] bundle[1583]: {"timestamp":"2026-09-13T12:08:02.694Z","pid":1583,"message":"- Worker 0 (PID: 2165) booted in 0.7s, phase: 0"}1276gitlab # [ 133.676047] bundle[1583]: {"timestamp":"2026-09-13T12:08:02.705Z","pid":1583,"message":"- Worker 1 (PID: 2169) booted in 0.69s, phase: 0"}1277gitlab # [ 133.682459] systemd[1]: Started gitlab.service.1278gitlab # [ 133.683827] systemd[1]: Reached target Common target for all GitLab services..1279gitlab # [ 133.685919] systemd[1]: Starting setup-gitlab.service...1280gitlab # [ 133.708594] setup-gitlab-start[2193]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1281gitlab # [ 134.023821] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:03.051Z","message":"Cleaning working queues"}1282gitlab # [ 134.024811] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:03.053Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"33130f5017a408c3b5a39519","created_at":"2026-09-13T12:07:01.836Z","trace_propagation_headers":{"sentry-trace":"69e36be9033143a8bdb925026f66ad97-3c946c4ba672485e","baggage":"sentry-trace_id=69e36be9033143a8bdb925026f66ad97,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"5f73c10d009d65f0c2e94d797fdac54b","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-13T12:07:01.844Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-33130f5017a408c3b5a39519: start","job_status":"start","queue_duration_s":61.20882,"scheduling_latency_s":61.208865}1283gitlab # [ 134.175831] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:03.204Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"33130f5017a408c3b5a39519","created_at":"2026-09-13T12:07:01.836Z","trace_propagation_headers":{"sentry-trace":"69e36be9033143a8bdb925026f66ad97-3c946c4ba672485e","baggage":"sentry-trace_id=69e36be9033143a8bdb925026f66ad97,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"5f73c10d009d65f0c2e94d797fdac54b","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-13T12:07:01.844Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-33130f5017a408c3b5a39519: done: 0.151272 sec","job_status":"done","queue_duration_s":61.20882,"scheduling_latency_s":61.208865,"redis_calls":26,"redis_duration_s":0.005736,"redis_read_bytes":914,"redis_write_bytes":2887,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.003133,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001551,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001052,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.058806,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.07058466899999999,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.151272,"completed_at":"2026-09-13T12:08:03.204Z","load_balancing_strategy":"primary","db_duration_s":0.036208,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1284gitlab # [ 135.655743] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:08:04 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 19201285gitlab # [ 135.662262] setup-gitlab-start[2193]: + TOKEN=nixbot-test-token-of-20-chars1286gitlab # [ 135.663574] setup-gitlab-start[2193]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1287gitlab # [ 135.677446] runuser[2218]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1288gitlab # [ 136.062941] setup-gitlab-start[2219]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1289gitlab # [ 136.064679] setup-gitlab-start[2219]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1290gitlab # [ 136.066184] setup-gitlab-start[2219]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1291gitlab # [ 136.641175] setup-gitlab-start[2219]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1292gitlab # [ 136.643225] setup-gitlab-start[2219]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1293gitlab # [ 136.644349] setup-gitlab-start[2219]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1294gitlab # [ 148.859500] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:17.887Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"bf1e1dc18046f403c4323b8f","created_at":"2026-09-13T12:08:17.852Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"973d51b4961979b841044156e136ce8b","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:17.884Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-bf1e1dc18046f403c4323b8f: start","job_status":"start","queue_duration_s":0.002824,"scheduling_latency_s":0.002879}1295gitlab # [ 148.927471] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:17.955Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"bf1e1dc18046f403c4323b8f","created_at":"2026-09-13T12:08:17.852Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"973d51b4961979b841044156e136ce8b","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:17.884Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-bf1e1dc18046f403c4323b8f: done: 0.068214 sec","job_status":"done","queue_duration_s":0.002824,"scheduling_latency_s":0.002879,"redis_calls":12,"redis_duration_s":0.011352000000000001,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001678,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002915,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.006759,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020921,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00280734,"exclusive_lock_hold_duration_s":0.005754362,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.068214,"completed_at":"2026-09-13T12:08:17.955Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013517,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1296gitlab # [ 148.930368] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:17.959Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"e5917aefdb3ceaf29978a89f","created_at":"2026-09-13T12:08:17.895Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"faca2bcd3b9628df1caf052e15cef953","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:17.909Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-e5917aefdb3ceaf29978a89f: start","job_status":"start","queue_duration_s":0.049051,"scheduling_latency_s":0.049093}1297gitlab # [ 149.481202] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:18.509Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"e5917aefdb3ceaf29978a89f","created_at":"2026-09-13T12:08:17.895Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"faca2bcd3b9628df1caf052e15cef953","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:17.909Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-e5917aefdb3ceaf29978a89f: done: 0.550971 sec","job_status":"done","queue_duration_s":0.049051,"scheduling_latency_s":0.049093,"redis_calls":14,"redis_duration_s":0.007618,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001116,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003861,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002641,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.128,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.128,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.214355,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000586667,"exclusive_lock_hold_duration_s":0.5127939450000001,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.550971,"completed_at":"2026-09-13T12:08:18.509Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.330686,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1298gitlab # [ 149.546653] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:18.575Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"6737a63736251f38fee9220a","created_at":"2026-09-13T12:08:17.930Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"efd2d9730d549ca8fec02aeb59b6d9f5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.023Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-6737a63736251f38fee9220a: start","job_status":"start","queue_duration_s":0.551515,"scheduling_latency_s":0.551562}1299gitlab # [ 149.621852] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:18.649Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"6737a63736251f38fee9220a","created_at":"2026-09-13T12:08:17.930Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"efd2d9730d549ca8fec02aeb59b6d9f5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.023Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-6737a63736251f38fee9220a: done: 0.074336 sec","job_status":"done","queue_duration_s":0.551515,"scheduling_latency_s":0.551562,"redis_calls":12,"redis_duration_s":0.023039999999999998,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.005431,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.015717,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001892,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023898,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000772445,"duration_s":0.074336,"completed_at":"2026-09-13T12:08:18.649Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004598,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1300gitlab # [ 149.630581] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:18.659Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"ebab3dcc58971a677aa11739","created_at":"2026-09-13T12:08:18.034Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fad8601f82ff030727a99f67da4a5e61","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-13T12:08:18.046Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-ebab3dcc58971a677aa11739: start","job_status":"start","queue_duration_s":0.612773,"scheduling_latency_s":0.61282}1301gitlab # [ 149.678251] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:18.706Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"ebab3dcc58971a677aa11739","created_at":"2026-09-13T12:08:18.034Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fad8601f82ff030727a99f67da4a5e61","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-13T12:08:18.046Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-ebab3dcc58971a677aa11739: done: 0.047899 sec","job_status":"done","queue_duration_s":0.612773,"scheduling_latency_s":0.61282,"redis_calls":10,"redis_duration_s":0.0031149999999999997,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000614,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001864,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000637,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024508,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0005104,"duration_s":0.047899,"completed_at":"2026-09-13T12:08:18.706Z","load_balancing_strategy":"primary","db_duration_s":0.00495,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1302gitlab # [ 149.682398] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:18.711Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"2d095ee7c1da1e935d726527","created_at":"2026-09-13T12:08:18.061Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b4bf1e6cb44455f4b0cea287e71e4a0c","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.069Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-2d095ee7c1da1e935d726527: start","job_status":"start","queue_duration_s":0.641815,"scheduling_latency_s":0.64183}1303gitlab # [ 149.707343] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:18.736Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"2d095ee7c1da1e935d726527","created_at":"2026-09-13T12:08:18.061Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b4bf1e6cb44455f4b0cea287e71e4a0c","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.069Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-2d095ee7c1da1e935d726527: done: 0.024667 sec","job_status":"done","queue_duration_s":0.641815,"scheduling_latency_s":0.64183,"redis_calls":10,"redis_duration_s":0.004639,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000657,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00283,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001152,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009363,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000300318,"duration_s":0.024667,"completed_at":"2026-09-13T12:08:18.736Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005989,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1304gitlab # [ 149.750457] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:18.740Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"9f7121a0ca67b3837dcea540","created_at":"2026-09-13T12:08:18.095Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.110Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-9f7121a0ca67b3837dcea540: start","job_status":"start","queue_duration_s":0.630036,"scheduling_latency_s":0.630051}1305gitlab # [ 149.797288] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:18.825Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"9f7121a0ca67b3837dcea540","created_at":"2026-09-13T12:08:18.095Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.110Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-9f7121a0ca67b3837dcea540: done: 0.085302 sec","job_status":"done","queue_duration_s":0.630036,"scheduling_latency_s":0.630051,"redis_calls":71,"redis_duration_s":0.019059,"redis_read_bytes":120,"redis_write_bytes":42624,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002422,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001096,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.014841,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.0007,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055907,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000346693,"duration_s":0.085302,"completed_at":"2026-09-13T12:08:18.825Z","load_balancing_strategy":"primary","db_duration_s":0.002587,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1306gitlab # [ 149.850905] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:18.879Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"4a0d1d48b82514bb1a893a51","created_at":"2026-09-13T12:08:18.128Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e18e3e81b4a8969a36e72b8f47cd2906","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.143Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-4a0d1d48b82514bb1a893a51: start","job_status":"start","queue_duration_s":0.735593,"scheduling_latency_s":0.735647}1307gitlab # [ 149.884986] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:18.912Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"4a0d1d48b82514bb1a893a51","created_at":"2026-09-13T12:08:18.128Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e18e3e81b4a8969a36e72b8f47cd2906","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.143Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-4a0d1d48b82514bb1a893a51: done: 0.033723 sec","job_status":"done","queue_duration_s":0.735593,"scheduling_latency_s":0.735647,"redis_calls":12,"redis_duration_s":0.003116,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000584,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000598,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001401,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000533,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019043,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000399772,"duration_s":0.033723,"completed_at":"2026-09-13T12:08:18.912Z","load_balancing_strategy":"primary","db_duration_s":0.000695,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1308gitlab # [ 149.924124] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:18.952Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"729735b349969ece566519d8","created_at":"2026-09-13T12:08:18.166Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cef1ac1fe62157218e8ff59c88347f3b","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.181Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-729735b349969ece566519d8: start","job_status":"start","queue_duration_s":0.771659,"scheduling_latency_s":0.771702}1309gitlab # [ 149.966281] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:18.994Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"729735b349969ece566519d8","created_at":"2026-09-13T12:08:18.166Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cef1ac1fe62157218e8ff59c88347f3b","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.181Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-729735b349969ece566519d8: done: 0.042174 sec","job_status":"done","queue_duration_s":0.771659,"scheduling_latency_s":0.771702,"redis_calls":10,"redis_duration_s":0.003153,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000713,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00183,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00061,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024145,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000524368,"duration_s":0.042174,"completed_at":"2026-09-13T12:08:18.994Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004491,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1310gitlab # [ 150.007679] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.036Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"689d4c8274c3949e59addd38","created_at":"2026-09-13T12:08:18.222Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"0cfba49f746ef657e22b3e3786e9a73d","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.233Z","job_size_bytes":3,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-689d4c8274c3949e59addd38: start","job_status":"start","queue_duration_s":0.802454,"scheduling_latency_s":0.802508}1311gitlab # [ 150.042751] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.070Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"689d4c8274c3949e59addd38","created_at":"2026-09-13T12:08:18.222Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"0cfba49f746ef657e22b3e3786e9a73d","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.233Z","job_size_bytes":3,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-689d4c8274c3949e59addd38: done: 0.034924 sec","job_status":"done","queue_duration_s":0.802454,"scheduling_latency_s":0.802508,"redis_calls":10,"redis_duration_s":0.004165,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001031,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00252,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000614,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018466,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000540572,"duration_s":0.034924,"completed_at":"2026-09-13T12:08:19.070Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000894,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1312gitlab # [ 150.046408] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.075Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"7bb8a8c5c97423bbeed2fab1","created_at":"2026-09-13T12:08:18.243Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"15bfe73a2c5e3b4b987f62ee0173ccd7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.254Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-7bb8a8c5c97423bbeed2fab1: start","job_status":"start","queue_duration_s":0.820699,"scheduling_latency_s":0.82073}1313gitlab # [ 150.108072] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.136Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"7bb8a8c5c97423bbeed2fab1","created_at":"2026-09-13T12:08:18.243Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"15bfe73a2c5e3b4b987f62ee0173ccd7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.254Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-7bb8a8c5c97423bbeed2fab1: done: 0.061589 sec","job_status":"done","queue_duration_s":0.820699,"scheduling_latency_s":0.82073,"redis_calls":14,"redis_duration_s":0.004568,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001238,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001878,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001452,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.015,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030755,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000665448,"exclusive_lock_hold_duration_s":0.028368689,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.061589,"completed_at":"2026-09-13T12:08:19.136Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017591,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1314gitlab # [ 150.111142] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.140Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"1dd0a136146ad68464ff1655","created_at":"2026-09-13T12:08:18.269Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0c4d126f06c524eacd060b03d2ca7c94","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.277Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-1dd0a136146ad68464ff1655: start","job_status":"start","queue_duration_s":0.862623,"scheduling_latency_s":0.862638}1315gitlab # [ 150.154702] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.183Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"1dd0a136146ad68464ff1655","created_at":"2026-09-13T12:08:18.269Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0c4d126f06c524eacd060b03d2ca7c94","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.277Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-1dd0a136146ad68464ff1655: done: 0.043376 sec","job_status":"done","queue_duration_s":0.862623,"scheduling_latency_s":0.862638,"redis_calls":12,"redis_duration_s":0.005207,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000624,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002628,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001955,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014372,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000568787,"exclusive_lock_hold_duration_s":0.012222223,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.043376,"completed_at":"2026-09-13T12:08:19.183Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017599,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1316gitlab # [ 150.162735] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.189Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"da26783b7587a85547a2a847","created_at":"2026-09-13T12:08:18.288Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0afc333cb58dac7c91b8671684726e81","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.297Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-da26783b7587a85547a2a847: start","job_status":"start","queue_duration_s":0.892588,"scheduling_latency_s":0.892604}1317gitlab # [ 150.188113] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.216Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"da26783b7587a85547a2a847","created_at":"2026-09-13T12:08:18.288Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0afc333cb58dac7c91b8671684726e81","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.297Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-da26783b7587a85547a2a847: done: 0.027293 sec","job_status":"done","queue_duration_s":0.892588,"scheduling_latency_s":0.892604,"redis_calls":16,"redis_duration_s":0.005932,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002341,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002624,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000967,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012465,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024193,"duration_s":0.027293,"completed_at":"2026-09-13T12:08:19.216Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005303,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1318gitlab # [ 150.231526] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.219Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"df3f1d55254b699a11a925b6","created_at":"2026-09-13T12:08:18.305Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"83b0fe07d72162e783b63e0abbbefe78","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.312Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-df3f1d55254b699a11a925b6: start","job_status":"start","queue_duration_s":0.907131,"scheduling_latency_s":0.907145}1319gitlab # [ 150.232366] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.238Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"df3f1d55254b699a11a925b6","created_at":"2026-09-13T12:08:18.305Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"83b0fe07d72162e783b63e0abbbefe78","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.312Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-df3f1d55254b699a11a925b6: done: 0.018531 sec","job_status":"done","queue_duration_s":0.907131,"scheduling_latency_s":0.907145,"redis_calls":12,"redis_duration_s":0.00247,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00045,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001136,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000884,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009771,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000344178,"exclusive_lock_hold_duration_s":0.005319671000000001,"duration_s":0.018531,"completed_at":"2026-09-13T12:08:19.238Z","load_balancing_strategy":"primary","db_duration_s":0.002856,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1320gitlab # [ 150.263912] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.239Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"c2f3462bf5931cb6f89e8e1f","created_at":"2026-09-13T12:08:18.327Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"df23dd1ae4f8be1be244c6edb02f5b1b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.331Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-c2f3462bf5931cb6f89e8e1f: start","job_status":"start","queue_duration_s":0.907859,"scheduling_latency_s":0.907874}1321gitlab # [ 150.310034] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.250Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1322gitlab # [ 150.310764] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.258Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"c2f3462bf5931cb6f89e8e1f","created_at":"2026-09-13T12:08:18.327Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"df23dd1ae4f8be1be244c6edb02f5b1b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.331Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-c2f3462bf5931cb6f89e8e1f: done: 0.01882 sec","job_status":"done","queue_duration_s":0.907859,"scheduling_latency_s":0.907874,"redis_calls":10,"redis_duration_s":0.006438,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000394,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001885,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004159,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007384,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000287747,"duration_s":0.01882,"completed_at":"2026-09-13T12:08:19.258Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000462,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1323gitlab # [ 150.319101] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.262Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"7e4ecb1bb2036c1340e27d78","created_at":"2026-09-13T12:08:18.345Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6739a1c5c3cb1c5e790600aa4f492720","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.356Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-7e4ecb1bb2036c1340e27d78: start","job_status":"start","queue_duration_s":0.905947,"scheduling_latency_s":0.905961}1324gitlab # [ 150.483424] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.512Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"7e4ecb1bb2036c1340e27d78","created_at":"2026-09-13T12:08:18.345Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6739a1c5c3cb1c5e790600aa4f492720","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.356Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-7e4ecb1bb2036c1340e27d78: done: 0.249248 sec","job_status":"done","queue_duration_s":0.905947,"scheduling_latency_s":0.905961,"redis_calls":565,"redis_duration_s":0.08577,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000307,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003191,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.082272,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.183437,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000302273,"duration_s":0.249248,"completed_at":"2026-09-13T12:08:19.512Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001077,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1325gitlab # [ 150.554588] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.583Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"5423ac2dcd344222b0d25ab3","created_at":"2026-09-13T12:08:18.363Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7ba5469101e1192182c046d24b5b64e5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.372Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-5423ac2dcd344222b0d25ab3: start","job_status":"start","queue_duration_s":1.210777,"scheduling_latency_s":1.210817}1326gitlab # [ 150.588425] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.617Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1327gitlab # [ 150.603344] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.631Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"5423ac2dcd344222b0d25ab3","created_at":"2026-09-13T12:08:18.363Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7ba5469101e1192182c046d24b5b64e5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.372Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-5423ac2dcd344222b0d25ab3: done: 0.048721 sec","job_status":"done","queue_duration_s":1.210777,"scheduling_latency_s":1.210817,"redis_calls":10,"redis_duration_s":0.004954,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00051,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003775,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000669,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018397,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000469892,"duration_s":0.048721,"completed_at":"2026-09-13T12:08:19.631Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00089,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1328gitlab # [ 150.643552] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.672Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"1d64462c493b53233bcbe9da","created_at":"2026-09-13T12:08:18.386Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fd685ea04f287ca74bd52e00bdd71688","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.395Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-1d64462c493b53233bcbe9da: start","job_status":"start","queue_duration_s":1.276223,"scheduling_latency_s":1.276268}1329gitlab # [ 150.693697] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.721Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"1d64462c493b53233bcbe9da","created_at":"2026-09-13T12:08:18.386Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fd685ea04f287ca74bd52e00bdd71688","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.395Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-1d64462c493b53233bcbe9da: done: 0.049574 sec","job_status":"done","queue_duration_s":1.276223,"scheduling_latency_s":1.276268,"redis_calls":12,"redis_duration_s":0.002901,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000491,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001402,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001008,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022173,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000682769,"exclusive_lock_hold_duration_s":0.007008432,"duration_s":0.049574,"completed_at":"2026-09-13T12:08:19.721Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003932,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1330gitlab # [ 150.734172] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.762Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"bba8adc962e2281c4cc6e424","created_at":"2026-09-13T12:08:18.409Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cdfe6b575556bd1c3efe4d79fb252165","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.415Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-bba8adc962e2281c4cc6e424: start","job_status":"start","queue_duration_s":1.347539,"scheduling_latency_s":1.347592}1331gitlab # [ 150.788787] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.817Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"bba8adc962e2281c4cc6e424","created_at":"2026-09-13T12:08:18.409Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cdfe6b575556bd1c3efe4d79fb252165","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.415Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-bba8adc962e2281c4cc6e424: done: 0.054854 sec","job_status":"done","queue_duration_s":1.347539,"scheduling_latency_s":1.347592,"redis_calls":19,"redis_duration_s":0.005846,"redis_read_bytes":22,"redis_write_bytes":4785,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001332,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000493,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003054,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000967,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036812,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000431619,"duration_s":0.054854,"completed_at":"2026-09-13T12:08:19.817Z","load_balancing_strategy":"primary","db_duration_s":0.00301,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1332gitlab # [ 150.793202] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.821Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"9bd03417876ecc87efc6876e","created_at":"2026-09-13T12:08:18.431Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a403bfae0b56ec4ac2e6273ed8a7558d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-13T12:08:18.439Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-9bd03417876ecc87efc6876e: start","job_status":"start","queue_duration_s":1.382073,"scheduling_latency_s":1.382101}1333gitlab # [ 150.812793] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.841Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1334gitlab # [ 150.820990] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.849Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"9bd03417876ecc87efc6876e","created_at":"2026-09-13T12:08:18.431Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a403bfae0b56ec4ac2e6273ed8a7558d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-13T12:08:18.439Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-9bd03417876ecc87efc6876e: done: 0.028139 sec","job_status":"done","queue_duration_s":1.382073,"scheduling_latency_s":1.382101,"redis_calls":10,"redis_duration_s":0.005194,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001341,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003255,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000598,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013399,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00042715,"duration_s":0.028139,"completed_at":"2026-09-13T12:08:19.849Z","load_balancing_strategy":"primary","db_duration_s":0.002094,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1335gitlab # [ 150.856818] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.855Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"02d5e872417b89847004d296","created_at":"2026-09-13T12:08:18.448Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"20a7cc513565b04c5586a8b736054ad5","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.453Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-02d5e872417b89847004d296: start","job_status":"start","queue_duration_s":1.40222,"scheduling_latency_s":1.402234}1336gitlab # [ 150.869706] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.895Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"02d5e872417b89847004d296","created_at":"2026-09-13T12:08:18.448Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"20a7cc513565b04c5586a8b736054ad5","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.453Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-02d5e872417b89847004d296: done: 0.039986 sec","job_status":"done","queue_duration_s":1.40222,"scheduling_latency_s":1.402234,"redis_calls":10,"redis_duration_s":0.005175,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001339,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002599,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001237,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011929,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000236901,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.039986,"completed_at":"2026-09-13T12:08:19.895Z","load_balancing_strategy":"primary","db_duration_s":0.018065,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1337gitlab # [ 150.935705] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.896Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"bd80224958df09e3e98a897a","created_at":"2026-09-13T12:08:18.461Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9670977a470530f230ab45206bf7e1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.469Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-bd80224958df09e3e98a897a: start","job_status":"start","queue_duration_s":1.427063,"scheduling_latency_s":1.427078}1338gitlab # [ 150.936693] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.905Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1339gitlab # [ 150.937197] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.910Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"bd80224958df09e3e98a897a","created_at":"2026-09-13T12:08:18.461Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9670977a470530f230ab45206bf7e1c3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.469Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-bd80224958df09e3e98a897a: done: 0.013303 sec","job_status":"done","queue_duration_s":1.427063,"scheduling_latency_s":1.427078,"redis_calls":10,"redis_duration_s":0.001497,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000257,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00097,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00027,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007548,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000206172,"duration_s":0.013303,"completed_at":"2026-09-13T12:08:19.910Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000341,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1340gitlab # [ 150.994778] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.911Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"6f2fe9fbf6990dd438ee474a","created_at":"2026-09-13T12:08:18.485Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cddaa63ac839c6578d40a2daaad39a1c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-13T12:08:18.497Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-6f2fe9fbf6990dd438ee474a: start","job_status":"start","queue_duration_s":1.4135,"scheduling_latency_s":1.413513}1341gitlab # [ 150.995809] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.918Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1342gitlab # [ 150.996578] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.923Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"6f2fe9fbf6990dd438ee474a","created_at":"2026-09-13T12:08:18.485Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cddaa63ac839c6578d40a2daaad39a1c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-13T12:08:18.497Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-6f2fe9fbf6990dd438ee474a: done: 0.011937 sec","job_status":"done","queue_duration_s":1.4135,"scheduling_latency_s":1.413513,"redis_calls":10,"redis_duration_s":0.00141,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000291,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000833,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000286,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006527,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000198908,"duration_s":0.011937,"completed_at":"2026-09-13T12:08:19.923Z","load_balancing_strategy":"primary","db_duration_s":0.000235,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1343gitlab # [ 151.048347] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.924Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"85336a066a4f1e95338b5215","created_at":"2026-09-13T12:08:18.570Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9f51e94008af46a82b369e7fdf90d950","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.586Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-85336a066a4f1e95338b5215: start","job_status":"start","queue_duration_s":1.338098,"scheduling_latency_s":1.338112}1344gitlab # [ 151.049091] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.946Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"85336a066a4f1e95338b5215","created_at":"2026-09-13T12:08:18.570Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9f51e94008af46a82b369e7fdf90d950","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.586Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-85336a066a4f1e95338b5215: done: 0.022056 sec","job_status":"done","queue_duration_s":1.338098,"scheduling_latency_s":1.338112,"redis_calls":13,"redis_duration_s":0.002077,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000256,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001122,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000699,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014669,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.006106923,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.022056,"completed_at":"2026-09-13T12:08:19.946Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001748,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1345gitlab # [ 151.106290] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.947Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"056d51a57b3f9699e53d2f26","created_at":"2026-09-13T12:08:18.611Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d36a2f0be65768d646768b5b33eb7541","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.634Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-056d51a57b3f9699e53d2f26: start","job_status":"start","queue_duration_s":1.313396,"scheduling_latency_s":1.313412}1346gitlab # [ 151.107095] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.961Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"056d51a57b3f9699e53d2f26","created_at":"2026-09-13T12:08:18.611Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d36a2f0be65768d646768b5b33eb7541","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.634Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-056d51a57b3f9699e53d2f26: done: 0.014015 sec","job_status":"done","queue_duration_s":1.313396,"scheduling_latency_s":1.313412,"redis_calls":10,"redis_duration_s":0.001449,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00028,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000917,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000252,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007941,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000198349,"duration_s":0.014015,"completed_at":"2026-09-13T12:08:19.961Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000309,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1347gitlab # [ 151.153108] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.962Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc708f5a2986b5a95c97b4e7","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc708f5a2986b5a95c97b4e7: start","job_status":"start","queue_duration_s":1.151847,"scheduling_latency_s":1.151861}1348gitlab # [ 151.153931] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.978Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc708f5a2986b5a95c97b4e7","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc708f5a2986b5a95c97b4e7: done: 0.016363 sec","job_status":"done","queue_duration_s":1.151847,"scheduling_latency_s":1.151861,"redis_calls":16,"redis_duration_s":0.002336,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00026,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000599,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001477,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008339,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000207288,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016363,"completed_at":"2026-09-13T12:08:19.978Z","load_balancing_strategy":"primary","db_duration_s":0.001896,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1349gitlab # [ 151.183284] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.979Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3a57792feb26b9cd3e9f1e7","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3a57792feb26b9cd3e9f1e7: start","job_status":"start","queue_duration_s":1.169076,"scheduling_latency_s":1.169089}1350gitlab # [ 151.194657] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.989Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3a57792feb26b9cd3e9f1e7","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3a57792feb26b9cd3e9f1e7: done: 0.009754 sec","job_status":"done","queue_duration_s":1.169076,"scheduling_latency_s":1.169089,"redis_calls":13,"redis_duration_s":0.001688,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001178,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006337,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009754,"completed_at":"2026-09-13T12:08:19.989Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1351gitlab # [ 151.239164] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.990Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8026ed0da532a1e0a1b96a33","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8026ed0da532a1e0a1b96a33: start","job_status":"start","queue_duration_s":1.179625,"scheduling_latency_s":1.179638}1352gitlab # [ 151.241234] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:19.999Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8026ed0da532a1e0a1b96a33","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8026ed0da532a1e0a1b96a33: done: 0.009587 sec","job_status":"done","queue_duration_s":1.179625,"scheduling_latency_s":1.179638,"redis_calls":13,"redis_duration_s":0.001712,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001152,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006166,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009587,"completed_at":"2026-09-13T12:08:19.999Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1353gitlab # [ 151.313308] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.000Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab00479b727b25cb655d688b","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab00479b727b25cb655d688b: start","job_status":"start","queue_duration_s":1.190043,"scheduling_latency_s":1.190056}1354gitlab # [ 151.313986] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.010Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab00479b727b25cb655d688b","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab00479b727b25cb655d688b: done: 0.009644 sec","job_status":"done","queue_duration_s":1.190043,"scheduling_latency_s":1.190056,"redis_calls":13,"redis_duration_s":0.001828,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000624,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001204,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005986,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009644,"completed_at":"2026-09-13T12:08:20.010Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1355gitlab # [ 151.354318] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.011Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"600df10b24a6be0f185a257a","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-600df10b24a6be0f185a257a: start","job_status":"start","queue_duration_s":1.200508,"scheduling_latency_s":1.200521}1356gitlab # [ 151.355124] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.020Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"600df10b24a6be0f185a257a","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-600df10b24a6be0f185a257a: done: 0.009833 sec","job_status":"done","queue_duration_s":1.200508,"scheduling_latency_s":1.200521,"redis_calls":13,"redis_duration_s":0.00174,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001194,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006274,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009833,"completed_at":"2026-09-13T12:08:20.020Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1357gitlab # [ 151.405276] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.021Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4f01fe2a7a0383ffb4c3db8a","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4f01fe2a7a0383ffb4c3db8a: start","job_status":"start","queue_duration_s":1.211236,"scheduling_latency_s":1.211249}1358gitlab # [ 151.405959] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.032Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4f01fe2a7a0383ffb4c3db8a","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4f01fe2a7a0383ffb4c3db8a: done: 0.01058 sec","job_status":"done","queue_duration_s":1.211236,"scheduling_latency_s":1.211249,"redis_calls":13,"redis_duration_s":0.002617,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006161,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01058,"completed_at":"2026-09-13T12:08:20.032Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1359gitlab # [ 151.416794] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.033Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a13c1ca56db953ec3c2a8f90","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a13c1ca56db953ec3c2a8f90: start","job_status":"start","queue_duration_s":1.222793,"scheduling_latency_s":1.222806}1360gitlab # [ 151.428576] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.042Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a13c1ca56db953ec3c2a8f90","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a13c1ca56db953ec3c2a8f90: done: 0.009467 sec","job_status":"done","queue_duration_s":1.222793,"scheduling_latency_s":1.222806,"redis_calls":13,"redis_duration_s":0.001561,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00103,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006047,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009467,"completed_at":"2026-09-13T12:08:20.042Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1361gitlab # [ 151.474152] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.043Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12b1159da1c0127659ce377b","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12b1159da1c0127659ce377b: start","job_status":"start","queue_duration_s":1.233389,"scheduling_latency_s":1.233403}1362gitlab # [ 151.474881] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.053Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12b1159da1c0127659ce377b","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12b1159da1c0127659ce377b: done: 0.009404 sec","job_status":"done","queue_duration_s":1.233389,"scheduling_latency_s":1.233403,"redis_calls":13,"redis_duration_s":0.0014919999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000489,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001003,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009404,"completed_at":"2026-09-13T12:08:20.053Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1363gitlab # [ 151.519568] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.054Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8167a9785261b2205fa33ba6","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8167a9785261b2205fa33ba6: start","job_status":"start","queue_duration_s":1.243844,"scheduling_latency_s":1.243858}1364gitlab # [ 151.521704] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.063Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8167a9785261b2205fa33ba6","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8167a9785261b2205fa33ba6: done: 0.009481 sec","job_status":"done","queue_duration_s":1.243844,"scheduling_latency_s":1.243858,"redis_calls":13,"redis_duration_s":0.001642,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000495,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001147,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006318,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009481,"completed_at":"2026-09-13T12:08:20.063Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1365gitlab # [ 151.564369] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.064Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b685f4c66a33c7593536b9a0","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b685f4c66a33c7593536b9a0: start","job_status":"start","queue_duration_s":1.254338,"scheduling_latency_s":1.254351}1366gitlab # [ 151.567924] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.074Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b685f4c66a33c7593536b9a0","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b685f4c66a33c7593536b9a0: done: 0.009789 sec","job_status":"done","queue_duration_s":1.254338,"scheduling_latency_s":1.254351,"redis_calls":13,"redis_duration_s":0.001855,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001314,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006456,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009789,"completed_at":"2026-09-13T12:08:20.074Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1367gitlab # [ 151.607640] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.075Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd3d5dcba0f85489c0349954","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd3d5dcba0f85489c0349954: start","job_status":"start","queue_duration_s":1.265102,"scheduling_latency_s":1.265114}1368gitlab # [ 151.614696] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.091Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd3d5dcba0f85489c0349954","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd3d5dcba0f85489c0349954: done: 0.015443 sec","job_status":"done","queue_duration_s":1.265102,"scheduling_latency_s":1.265114,"redis_calls":13,"redis_duration_s":0.0033309999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001583,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001748,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006624,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015443,"completed_at":"2026-09-13T12:08:20.091Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1369gitlab # [ 151.651344] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.092Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c1424946b149119a45c16e29","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c1424946b149119a45c16e29: start","job_status":"start","queue_duration_s":1.281521,"scheduling_latency_s":1.281534}1370gitlab # [ 151.662934] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.101Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c1424946b149119a45c16e29","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c1424946b149119a45c16e29: done: 0.00946 sec","job_status":"done","queue_duration_s":1.281521,"scheduling_latency_s":1.281534,"redis_calls":13,"redis_duration_s":0.0015270000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000981,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006169,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00946,"completed_at":"2026-09-13T12:08:20.101Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371gitlab # [ 151.717293] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.102Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e261f43fc91344729e3e8618","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e261f43fc91344729e3e8618: start","job_status":"start","queue_duration_s":1.29179,"scheduling_latency_s":1.291802}1372gitlab # [ 151.718045] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.112Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e261f43fc91344729e3e8618","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e261f43fc91344729e3e8618: done: 0.009699 sec","job_status":"done","queue_duration_s":1.29179,"scheduling_latency_s":1.291802,"redis_calls":13,"redis_duration_s":0.001531,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001016,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006309,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009699,"completed_at":"2026-09-13T12:08:20.112Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1373gitlab # [ 151.765565] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.112Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2221113bd9e7b906c91b0005","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2221113bd9e7b906c91b0005: start","job_status":"start","queue_duration_s":1.302371,"scheduling_latency_s":1.302385}1374gitlab # [ 151.766578] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.122Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2221113bd9e7b906c91b0005","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2221113bd9e7b906c91b0005: done: 0.009779 sec","job_status":"done","queue_duration_s":1.302371,"scheduling_latency_s":1.302385,"redis_calls":13,"redis_duration_s":0.00165,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001136,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006157,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009779,"completed_at":"2026-09-13T12:08:20.122Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1375gitlab # [ 151.827224] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.123Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7d9e63c836b6f6b1a2518fa","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7d9e63c836b6f6b1a2518fa: start","job_status":"start","queue_duration_s":1.31301,"scheduling_latency_s":1.313023}1376gitlab # [ 151.828091] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.133Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7d9e63c836b6f6b1a2518fa","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7d9e63c836b6f6b1a2518fa: done: 0.009458 sec","job_status":"done","queue_duration_s":1.31301,"scheduling_latency_s":1.313023,"redis_calls":13,"redis_duration_s":0.001537,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000492,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001045,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006167,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009458,"completed_at":"2026-09-13T12:08:20.132Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1377gitlab # [ 151.839248] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.133Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20e73220715649c41f15243e","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20e73220715649c41f15243e: start","job_status":"start","queue_duration_s":1.323291,"scheduling_latency_s":1.323304}1378gitlab # [ 151.850987] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.143Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20e73220715649c41f15243e","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20e73220715649c41f15243e: done: 0.010003 sec","job_status":"done","queue_duration_s":1.323291,"scheduling_latency_s":1.323304,"redis_calls":13,"redis_duration_s":0.001522,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000498,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001024,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006038,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010003,"completed_at":"2026-09-13T12:08:20.143Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379gitlab # [ 151.907410] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.144Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af84d4fd4cc06e27351b7f9d","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af84d4fd4cc06e27351b7f9d: start","job_status":"start","queue_duration_s":1.334178,"scheduling_latency_s":1.334191}1380gitlab # [ 151.908083] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.154Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af84d4fd4cc06e27351b7f9d","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af84d4fd4cc06e27351b7f9d: done: 0.009425 sec","job_status":"done","queue_duration_s":1.334178,"scheduling_latency_s":1.334191,"redis_calls":13,"redis_duration_s":0.0015890000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001083,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00604,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009425,"completed_at":"2026-09-13T12:08:20.154Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1381gitlab # [ 151.965801] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.155Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7bc82df3df36239c859d55a","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7bc82df3df36239c859d55a: start","job_status":"start","queue_duration_s":1.344722,"scheduling_latency_s":1.344758}1382gitlab # [ 151.966932] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.164Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7bc82df3df36239c859d55a","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7bc82df3df36239c859d55a: done: 0.009346 sec","job_status":"done","queue_duration_s":1.344722,"scheduling_latency_s":1.344758,"redis_calls":13,"redis_duration_s":0.001537,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000488,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001049,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006176,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009346,"completed_at":"2026-09-13T12:08:20.164Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1383gitlab # [ 151.981256] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.165Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ba5b91425b1b831ffab8299","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ba5b91425b1b831ffab8299: start","job_status":"start","queue_duration_s":1.355056,"scheduling_latency_s":1.355069}1384gitlab # [ 151.993117] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.175Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ba5b91425b1b831ffab8299","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ba5b91425b1b831ffab8299: done: 0.009543 sec","job_status":"done","queue_duration_s":1.355056,"scheduling_latency_s":1.355069,"redis_calls":13,"redis_duration_s":0.001561,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001056,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006535,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009543,"completed_at":"2026-09-13T12:08:20.175Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1385gitlab # [ 152.043640] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.176Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55665e89e855cf6f98f8dcb0","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55665e89e855cf6f98f8dcb0: start","job_status":"start","queue_duration_s":1.36557,"scheduling_latency_s":1.365583}1386gitlab # [ 152.044557] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.191Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55665e89e855cf6f98f8dcb0","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55665e89e855cf6f98f8dcb0: done: 0.015756 sec","job_status":"done","queue_duration_s":1.36557,"scheduling_latency_s":1.365583,"redis_calls":13,"redis_duration_s":0.007443,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002438,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005005,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00679,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015756,"completed_at":"2026-09-13T12:08:20.191Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1387gitlab # [ 152.086741] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.195Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"657f9bd0f8d0ab3069f55a55","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-657f9bd0f8d0ab3069f55a55: start","job_status":"start","queue_duration_s":1.385034,"scheduling_latency_s":1.38505}1388gitlab # [ 152.087731] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.274Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"657f9bd0f8d0ab3069f55a55","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-657f9bd0f8d0ab3069f55a55: done: 0.07869 sec","job_status":"done","queue_duration_s":1.385034,"scheduling_latency_s":1.38505,"redis_calls":13,"redis_duration_s":0.00902,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002237,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006783,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.065714,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.07869,"completed_at":"2026-09-13T12:08:20.274Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1389gitlab # [ 152.123027] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.277Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8737c6f6567cbef8a0efc75","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8737c6f6567cbef8a0efc75: start","job_status":"start","queue_duration_s":1.467152,"scheduling_latency_s":1.467173}1390gitlab # [ 152.134124] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.297Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8737c6f6567cbef8a0efc75","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8737c6f6567cbef8a0efc75: done: 0.019483 sec","job_status":"done","queue_duration_s":1.467152,"scheduling_latency_s":1.467173,"redis_calls":13,"redis_duration_s":0.006206999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004153,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0086,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019483,"completed_at":"2026-09-13T12:08:20.297Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1391gitlab # [ 152.182753] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.299Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0bfe3bf204f56e2b8e17f678","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0bfe3bf204f56e2b8e17f678: start","job_status":"start","queue_duration_s":1.489156,"scheduling_latency_s":1.489172}1392gitlab # [ 152.183629] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.310Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0bfe3bf204f56e2b8e17f678","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0bfe3bf204f56e2b8e17f678: done: 0.011116 sec","job_status":"done","queue_duration_s":1.489156,"scheduling_latency_s":1.489172,"redis_calls":13,"redis_duration_s":0.002294,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000805,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001489,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006161,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011116,"completed_at":"2026-09-13T12:08:20.310Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1393gitlab # [ 152.214569] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.311Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"235d60e911c45709e6c23543","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-235d60e911c45709e6c23543: start","job_status":"start","queue_duration_s":1.501309,"scheduling_latency_s":1.501323}1394gitlab # [ 152.225559] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.326Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"235d60e911c45709e6c23543","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-235d60e911c45709e6c23543: done: 0.01475 sec","job_status":"done","queue_duration_s":1.501309,"scheduling_latency_s":1.501323,"redis_calls":13,"redis_duration_s":0.003432,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002239,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001193,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009085,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01475,"completed_at":"2026-09-13T12:08:20.326Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1395gitlab # [ 152.292673] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.327Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a6b8a18968d7cd8659f3298","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a6b8a18968d7cd8659f3298: start","job_status":"start","queue_duration_s":1.517191,"scheduling_latency_s":1.517212}1396gitlab # [ 152.293489] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.337Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a6b8a18968d7cd8659f3298","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a6b8a18968d7cd8659f3298: done: 0.00996 sec","job_status":"done","queue_duration_s":1.517191,"scheduling_latency_s":1.517212,"redis_calls":13,"redis_duration_s":0.001509,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000989,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006506,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00996,"completed_at":"2026-09-13T12:08:20.337Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1397gitlab # [ 152.305644] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.338Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3b4e4a1a776e652e03f1a9b","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3b4e4a1a776e652e03f1a9b: start","job_status":"start","queue_duration_s":1.527941,"scheduling_latency_s":1.527954}1398gitlab # [ 152.316845] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.348Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3b4e4a1a776e652e03f1a9b","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3b4e4a1a776e652e03f1a9b: done: 0.00957 sec","job_status":"done","queue_duration_s":1.527941,"scheduling_latency_s":1.527954,"redis_calls":13,"redis_duration_s":0.001783,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000624,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001159,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005778,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00957,"completed_at":"2026-09-13T12:08:20.348Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1399gitlab # [ 152.356319] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.349Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6022258cf2eb870f5219778e","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6022258cf2eb870f5219778e: start","job_status":"start","queue_duration_s":1.53884,"scheduling_latency_s":1.538854}1400gitlab # [ 152.398765] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.358Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6022258cf2eb870f5219778e","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6022258cf2eb870f5219778e: done: 0.009317 sec","job_status":"done","queue_duration_s":1.53884,"scheduling_latency_s":1.538854,"redis_calls":13,"redis_duration_s":0.0014949999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000478,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001017,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006307,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009317,"completed_at":"2026-09-13T12:08:20.358Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1401gitlab # [ 152.400033] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.359Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5cefacde347e532d4732dccb","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5cefacde347e532d4732dccb: start","job_status":"start","queue_duration_s":1.548995,"scheduling_latency_s":1.549008}1402gitlab # [ 152.443834] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.368Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5cefacde347e532d4732dccb","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5cefacde347e532d4732dccb: done: 0.009363 sec","job_status":"done","queue_duration_s":1.548995,"scheduling_latency_s":1.549008,"redis_calls":13,"redis_duration_s":0.0015609999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001055,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006318,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009363,"completed_at":"2026-09-13T12:08:20.368Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1403gitlab # [ 152.444930] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.369Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ddcfcf7148109dedaa0a6dde","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ddcfcf7148109dedaa0a6dde: start","job_status":"start","queue_duration_s":1.559191,"scheduling_latency_s":1.559205}1404gitlab # [ 152.489124] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.379Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ddcfcf7148109dedaa0a6dde","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ddcfcf7148109dedaa0a6dde: done: 0.009405 sec","job_status":"done","queue_duration_s":1.559191,"scheduling_latency_s":1.559205,"redis_calls":13,"redis_duration_s":0.0017130000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000491,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001222,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006262,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009405,"completed_at":"2026-09-13T12:08:20.379Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1405gitlab # [ 152.490079] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.379Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07e72f35a3ed7256db7065fb","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07e72f35a3ed7256db7065fb: start","job_status":"start","queue_duration_s":1.569434,"scheduling_latency_s":1.569447}1406gitlab # [ 152.497700] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.394Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07e72f35a3ed7256db7065fb","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07e72f35a3ed7256db7065fb: done: 0.014707 sec","job_status":"done","queue_duration_s":1.569434,"scheduling_latency_s":1.569447,"redis_calls":13,"redis_duration_s":0.00621,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001029,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005181,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005972,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014707,"completed_at":"2026-09-13T12:08:20.394Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1407gitlab # [ 152.533030] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.396Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8be822a64a6a0692d03a2e89","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8be822a64a6a0692d03a2e89: start","job_status":"start","queue_duration_s":1.585635,"scheduling_latency_s":1.58565}1408gitlab # [ 152.544208] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.405Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8be822a64a6a0692d03a2e89","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8be822a64a6a0692d03a2e89: done: 0.009443 sec","job_status":"done","queue_duration_s":1.585635,"scheduling_latency_s":1.58565,"redis_calls":13,"redis_duration_s":0.001543,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001031,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006279,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009443,"completed_at":"2026-09-13T12:08:20.405Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1409gitlab # [ 152.584159] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.406Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4535b92487ff11e04979ba05","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4535b92487ff11e04979ba05: start","job_status":"start","queue_duration_s":1.595891,"scheduling_latency_s":1.595904}1410gitlab # [ 152.589073] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.415Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4535b92487ff11e04979ba05","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4535b92487ff11e04979ba05: done: 0.009025 sec","job_status":"done","queue_duration_s":1.595891,"scheduling_latency_s":1.595904,"redis_calls":13,"redis_duration_s":0.001491,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00048,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001011,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006118,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009025,"completed_at":"2026-09-13T12:08:20.415Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1411gitlab # [ 152.637709] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.416Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd3ecbd4ecdde6e043809a15","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd3ecbd4ecdde6e043809a15: start","job_status":"start","queue_duration_s":1.605717,"scheduling_latency_s":1.60573}1412gitlab # [ 152.638601] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.425Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd3ecbd4ecdde6e043809a15","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd3ecbd4ecdde6e043809a15: done: 0.009101 sec","job_status":"done","queue_duration_s":1.605717,"scheduling_latency_s":1.60573,"redis_calls":13,"redis_duration_s":0.001514,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006112,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009101,"completed_at":"2026-09-13T12:08:20.425Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413gitlab # [ 152.694981] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.426Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43c2f83506f988fe99493051","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43c2f83506f988fe99493051: start","job_status":"start","queue_duration_s":1.61561,"scheduling_latency_s":1.615622}1414gitlab # [ 152.695422] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.439Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43c2f83506f988fe99493051","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43c2f83506f988fe99493051: done: 0.013486 sec","job_status":"done","queue_duration_s":1.61561,"scheduling_latency_s":1.615622,"redis_calls":13,"redis_duration_s":0.0032860000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000671,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002615,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007663,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013486,"completed_at":"2026-09-13T12:08:20.439Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415gitlab # [ 152.740601] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12c538af68324251c3734423","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12c538af68324251c3734423: start","job_status":"start","queue_duration_s":1.630766,"scheduling_latency_s":1.630788}1416gitlab # [ 152.741546] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.452Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12c538af68324251c3734423","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12c538af68324251c3734423: done: 0.011207 sec","job_status":"done","queue_duration_s":1.630766,"scheduling_latency_s":1.630788,"redis_calls":13,"redis_duration_s":0.001544,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001031,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006717,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011207,"completed_at":"2026-09-13T12:08:20.452Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1417gitlab # [ 152.759528] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.453Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b428593aa2a9a33580fb3d2","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b428593aa2a9a33580fb3d2: start","job_status":"start","queue_duration_s":1.642728,"scheduling_latency_s":1.642774}1418gitlab # [ 152.798611] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.462Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b428593aa2a9a33580fb3d2","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b428593aa2a9a33580fb3d2: done: 0.009307 sec","job_status":"done","queue_duration_s":1.642728,"scheduling_latency_s":1.642774,"redis_calls":13,"redis_duration_s":0.0015730000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001023,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00603,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009307,"completed_at":"2026-09-13T12:08:20.462Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1419gitlab # [ 152.840715] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.463Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d1fee286f1d4c1d6afad164","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d1fee286f1d4c1d6afad164: start","job_status":"start","queue_duration_s":1.65287,"scheduling_latency_s":1.652883}1420gitlab # [ 152.841613] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.472Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d1fee286f1d4c1d6afad164","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d1fee286f1d4c1d6afad164: done: 0.009199 sec","job_status":"done","queue_duration_s":1.65287,"scheduling_latency_s":1.652883,"redis_calls":13,"redis_duration_s":0.001582,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001067,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005551,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009199,"completed_at":"2026-09-13T12:08:20.472Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1421gitlab # [ 152.881648] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.473Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b2945fe0735568506a354e38","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b2945fe0735568506a354e38: start","job_status":"start","queue_duration_s":1.663288,"scheduling_latency_s":1.663302}1422gitlab # [ 152.882524] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.483Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b2945fe0735568506a354e38","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b2945fe0735568506a354e38: done: 0.00965 sec","job_status":"done","queue_duration_s":1.663288,"scheduling_latency_s":1.663302,"redis_calls":13,"redis_duration_s":0.002032,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00098,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001052,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006088,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00965,"completed_at":"2026-09-13T12:08:20.483Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1423gitlab # [ 152.921919] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.484Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e8e41e238d631bc0afed4e34","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e8e41e238d631bc0afed4e34: start","job_status":"start","queue_duration_s":1.673813,"scheduling_latency_s":1.673827}1424gitlab # [ 152.922736] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.493Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e8e41e238d631bc0afed4e34","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e8e41e238d631bc0afed4e34: done: 0.009044 sec","job_status":"done","queue_duration_s":1.673813,"scheduling_latency_s":1.673827,"redis_calls":13,"redis_duration_s":0.001601,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006016,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009044,"completed_at":"2026-09-13T12:08:20.493Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425gitlab # [ 152.972708] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.494Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab63c79cda9c3a5710252e9c","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab63c79cda9c3a5710252e9c: start","job_status":"start","queue_duration_s":1.683668,"scheduling_latency_s":1.68368}1426gitlab # [ 152.973676] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.503Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab63c79cda9c3a5710252e9c","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab63c79cda9c3a5710252e9c: done: 0.008951 sec","job_status":"done","queue_duration_s":1.683668,"scheduling_latency_s":1.68368,"redis_calls":13,"redis_duration_s":0.001849,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000807,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001042,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008951,"completed_at":"2026-09-13T12:08:20.503Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1427gitlab # [ 152.983273] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.507Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"888ec3e2b44cacbc62691f1d","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-888ec3e2b44cacbc62691f1d: start","job_status":"start","queue_duration_s":1.697165,"scheduling_latency_s":1.697179}1428gitlab # [ 152.994998] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.517Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"888ec3e2b44cacbc62691f1d","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-888ec3e2b44cacbc62691f1d: done: 0.009416 sec","job_status":"done","queue_duration_s":1.697165,"scheduling_latency_s":1.697179,"redis_calls":13,"redis_duration_s":0.001598,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001093,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005835,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009416,"completed_at":"2026-09-13T12:08:20.517Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1429gitlab # [ 153.053671] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.518Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f506080a17cb5ab9a6fb464e","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f506080a17cb5ab9a6fb464e: start","job_status":"start","queue_duration_s":1.707889,"scheduling_latency_s":1.707902}1430gitlab # [ 153.054526] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.527Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f506080a17cb5ab9a6fb464e","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f506080a17cb5ab9a6fb464e: done: 0.009322 sec","job_status":"done","queue_duration_s":1.707889,"scheduling_latency_s":1.707902,"redis_calls":13,"redis_duration_s":0.001559,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001046,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006268,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009322,"completed_at":"2026-09-13T12:08:20.527Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1431gitlab # [ 153.104637] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.528Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2967119445a7aeab246f3c05","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2967119445a7aeab246f3c05: start","job_status":"start","queue_duration_s":1.718049,"scheduling_latency_s":1.718063}1432gitlab # [ 153.105512] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.537Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2967119445a7aeab246f3c05","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2967119445a7aeab246f3c05: done: 0.008984 sec","job_status":"done","queue_duration_s":1.718049,"scheduling_latency_s":1.718063,"redis_calls":13,"redis_duration_s":0.001539,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006012,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008984,"completed_at":"2026-09-13T12:08:20.537Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1433gitlab # [ 153.145758] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.538Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0031aad077b3c5444a27660a","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0031aad077b3c5444a27660a: start","job_status":"start","queue_duration_s":1.727943,"scheduling_latency_s":1.727957}1434gitlab # [ 153.146555] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.547Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0031aad077b3c5444a27660a","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0031aad077b3c5444a27660a: done: 0.009094 sec","job_status":"done","queue_duration_s":1.727943,"scheduling_latency_s":1.727957,"redis_calls":13,"redis_duration_s":0.00157,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001055,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006081,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009094,"completed_at":"2026-09-13T12:08:20.547Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1435gitlab # [ 153.189218] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.551Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9b2fbfa41af754f55856d34","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9b2fbfa41af754f55856d34: start","job_status":"start","queue_duration_s":1.740782,"scheduling_latency_s":1.740796}1436gitlab # [ 153.189985] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.561Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9b2fbfa41af754f55856d34","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9b2fbfa41af754f55856d34: done: 0.010326 sec","job_status":"done","queue_duration_s":1.740782,"scheduling_latency_s":1.740796,"redis_calls":13,"redis_duration_s":0.0015739999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001052,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005741,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010326,"completed_at":"2026-09-13T12:08:20.561Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1437gitlab # [ 153.207270] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.562Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e86c025b2fffc0da16a0973c","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e86c025b2fffc0da16a0973c: start","job_status":"start","queue_duration_s":1.751906,"scheduling_latency_s":1.751919}1438gitlab # [ 153.218790] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.571Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e86c025b2fffc0da16a0973c","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e86c025b2fffc0da16a0973c: done: 0.00909 sec","job_status":"done","queue_duration_s":1.751906,"scheduling_latency_s":1.751919,"redis_calls":13,"redis_duration_s":0.001529,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00049,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001039,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006117,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00909,"completed_at":"2026-09-13T12:08:20.571Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1439gitlab # [ 153.254126] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.572Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d8ab88d661cb44cd28c572b","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d8ab88d661cb44cd28c572b: start","job_status":"start","queue_duration_s":1.761814,"scheduling_latency_s":1.761827}1440gitlab # [ 153.299820] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.581Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d8ab88d661cb44cd28c572b","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d8ab88d661cb44cd28c572b: done: 0.00892 sec","job_status":"done","queue_duration_s":1.761814,"scheduling_latency_s":1.761827,"redis_calls":13,"redis_duration_s":0.001499,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000483,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001016,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005983,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00892,"completed_at":"2026-09-13T12:08:20.581Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1441gitlab # [ 153.300962] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.582Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0525a1bb26845b1974eb9d6e","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0525a1bb26845b1974eb9d6e: start","job_status":"start","queue_duration_s":1.771553,"scheduling_latency_s":1.771566}1442gitlab # [ 153.310751] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.591Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0525a1bb26845b1974eb9d6e","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0525a1bb26845b1974eb9d6e: done: 0.009306 sec","job_status":"done","queue_duration_s":1.771553,"scheduling_latency_s":1.771566,"redis_calls":13,"redis_duration_s":0.001552,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001018,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006317,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009306,"completed_at":"2026-09-13T12:08:20.591Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1443gitlab # [ 153.353091] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.592Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43b0c20a7932c51b001819a8","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43b0c20a7932c51b001819a8: start","job_status":"start","queue_duration_s":1.781651,"scheduling_latency_s":1.781663}1444gitlab # [ 153.391697] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.605Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43b0c20a7932c51b001819a8","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43b0c20a7932c51b001819a8: done: 0.012933 sec","job_status":"done","queue_duration_s":1.781651,"scheduling_latency_s":1.781663,"redis_calls":13,"redis_duration_s":0.001603,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001057,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006429,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012933,"completed_at":"2026-09-13T12:08:20.605Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1445gitlab # [ 153.392750] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.605Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f5d71421753037fe40c56896","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f5d71421753037fe40c56896: start","job_status":"start","queue_duration_s":1.79543,"scheduling_latency_s":1.795444}1446gitlab # [ 153.400858] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.615Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f5d71421753037fe40c56896","created_at":"2026-09-13T12:08:18.756Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-c9b6f928d3354e9f","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"447cc706707d8d3ffdeadf2291d73b14","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.810Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f5d71421753037fe40c56896: done: 0.009302 sec","job_status":"done","queue_duration_s":1.79543,"scheduling_latency_s":1.795444,"redis_calls":13,"redis_duration_s":0.001539,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001021,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006289,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009302,"completed_at":"2026-09-13T12:08:20.615Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1447gitlab # [ 153.441072] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.616Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"ef757bd7f00f61f5f579555b","created_at":"2026-09-13T12:08:18.651Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dc67f5001452801af185b3052a355e3c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.822Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-ef757bd7f00f61f5f579555b: start","job_status":"start","queue_duration_s":1.793238,"scheduling_latency_s":1.793251}1448gitlab # [ 153.447334] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.624Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1449gitlab # [ 153.450805] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.629Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"ef757bd7f00f61f5f579555b","created_at":"2026-09-13T12:08:18.651Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-8514514489dd4c6c","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dc67f5001452801af185b3052a355e3c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-13T12:08:18.822Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-ef757bd7f00f61f5f579555b: done: 0.012923 sec","job_status":"done","queue_duration_s":1.793238,"scheduling_latency_s":1.793251,"redis_calls":10,"redis_duration_s":0.001825,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000319,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00075,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000756,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007465,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000240533,"duration_s":0.012923,"completed_at":"2026-09-13T12:08:20.629Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000584,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1450gitlab # [ 153.489534] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.630Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"2592dc3ce0dc7d6853a2df0e","created_at":"2026-09-13T12:08:19.788Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-5c30ef84d9654f66","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cdfe6b575556bd1c3efe4d79fb252165","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:19.807Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-2592dc3ce0dc7d6853a2df0e: start","job_status":"start","queue_duration_s":0.822927,"scheduling_latency_s":0.82294}1451gitlab # [ 153.500549] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.647Z","message":"No existing merge request to be cleaned up."}1452gitlab # [ 153.501988] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.660Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"2592dc3ce0dc7d6853a2df0e","created_at":"2026-09-13T12:08:19.788Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-5c30ef84d9654f66","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cdfe6b575556bd1c3efe4d79fb252165","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:19.807Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-2592dc3ce0dc7d6853a2df0e: done: 0.030214 sec","job_status":"done","queue_duration_s":0.822927,"scheduling_latency_s":0.82294,"redis_calls":13,"redis_duration_s":0.009358,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003662,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002166,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00353,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011782,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000968559,"duration_s":0.030214,"completed_at":"2026-09-13T12:08:20.660Z","load_balancing_strategy":"primary","db_duration_s":0.009353,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1453gitlab # [ 153.541701] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.663Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c56f512c97bf21efdf68838c","created_at":"2026-09-13T12:08:19.788Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-5c30ef84d9654f66","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cdfe6b575556bd1c3efe4d79fb252165","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:19.807Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c56f512c97bf21efdf68838c: start","job_status":"start","queue_duration_s":0.856417,"scheduling_latency_s":0.856432}1454gitlab # [ 153.547766] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.675Z","message":"No existing merge request to be cleaned up."}1455gitlab # [ 153.549578] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.684Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c56f512c97bf21efdf68838c","created_at":"2026-09-13T12:08:19.788Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-5c30ef84d9654f66","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cdfe6b575556bd1c3efe4d79fb252165","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:19.807Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c56f512c97bf21efdf68838c: done: 0.020727 sec","job_status":"done","queue_duration_s":0.856417,"scheduling_latency_s":0.856432,"redis_calls":10,"redis_duration_s":0.007009,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00267,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.004339,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007687,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020727,"completed_at":"2026-09-13T12:08:20.684Z","load_balancing_strategy":"primary","db_duration_s":0.004594,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1456gitlab # [ 153.588295] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.687Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"404656c6081570749c20a597","created_at":"2026-09-13T12:08:19.788Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-5c30ef84d9654f66","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cdfe6b575556bd1c3efe4d79fb252165","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:19.807Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-404656c6081570749c20a597: start","job_status":"start","queue_duration_s":0.8804,"scheduling_latency_s":0.880414}1457gitlab # [ 153.627952] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.697Z","message":"No existing merge request to be cleaned up."}1458gitlab # [ 153.628860] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.705Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"404656c6081570749c20a597","created_at":"2026-09-13T12:08:19.788Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-5c30ef84d9654f66","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cdfe6b575556bd1c3efe4d79fb252165","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:19.807Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-404656c6081570749c20a597: done: 0.018273 sec","job_status":"done","queue_duration_s":0.8804,"scheduling_latency_s":0.880414,"redis_calls":10,"redis_duration_s":0.006761,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002449,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.004312,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00815,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018273,"completed_at":"2026-09-13T12:08:20.705Z","load_balancing_strategy":"primary","db_duration_s":0.001379,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1459gitlab # [ 153.630545] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.706Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"81cda249c604dac516bf6b40","created_at":"2026-09-13T12:08:19.788Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-5c30ef84d9654f66","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cdfe6b575556bd1c3efe4d79fb252165","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:19.807Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-81cda249c604dac516bf6b40: start","job_status":"start","queue_duration_s":0.899848,"scheduling_latency_s":0.899862}1460gitlab # [ 153.640318] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.713Z","message":"No existing merge request to be cleaned up."}1461gitlab # [ 153.641849] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:20.717Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"81cda249c604dac516bf6b40","created_at":"2026-09-13T12:08:19.788Z","trace_propagation_headers":{"sentry-trace":"9a84e2865b5b41229fe877a8af8c0a2d-5c30ef84d9654f66","baggage":"sentry-trace_id=9a84e2865b5b41229fe877a8af8c0a2d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cdfe6b575556bd1c3efe4d79fb252165","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:08:19.807Z","job_size_bytes":2,"pid":1613,"sidekiq_tid":"mae1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-81cda249c604dac516bf6b40: done: 0.011071 sec","job_status":"done","queue_duration_s":0.899848,"scheduling_latency_s":0.899862,"redis_calls":10,"redis_duration_s":0.0013210000000000001,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000818,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0074,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011071,"completed_at":"2026-09-13T12:08:20.717Z","load_balancing_strategy":"primary","db_duration_s":0.000913,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1462gitlab # [ 153.862907] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 1465899280 wd_nsec: 14658993001463gitlab # [ 162.063668] setup-gitlab-start[2219]: W, [2026-09-13T12:08:31.091944 #2219] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1464gitlab # [ 183.524512] postgres[2420]: [2420] ERROR: relation "table_without_models" does not exist1465gitlab # [ 183.526607] postgres[2420]: [2420] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1466gitlab # [ 186.392658] runuser[2218]: pam_unix(runuser:session): session closed for user gitlab1467gitlab # [ 186.395580] setup-gitlab-start[2193]: + systemctl restart gitlab-sidekiq.service1468gitlab # [ 186.425972] systemd[1]: Stopping gitlab-sidekiq.service...1469gitlab # [ 186.428656] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:55.455Z","message":"Shutting down"}1470gitlab # [ 186.430241] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:55.455Z","message":"Scheduler exiting..."}1471gitlab # [ 186.432007] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:55.456Z","message":"Terminating quiet threads for default capsule"}1472gitlab # [ 186.432790] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:55.456Z","message":"Scheduler exiting..."}1473gitlab # [ 186.928810] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:55.957Z","message":"Pausing to allow jobs to finish..."}1474gitlab # [ 187.431876] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:56.460Z","message":"Bye!"}1475gitlab # [ 187.458626] sidekiq-cluster[1613]: {"severity":"INFO","time":"2026-09-13T12:08:56.487Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1613,"worker_id":"sidekiq_0","memwd_rss_bytes":942985216,"retry":0}1476gitlab # [ 191.271323] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1477gitlab # [ 191.273784] systemd[1]: Stopped gitlab-sidekiq.service.1478gitlab # [ 191.275966] systemd[1]: gitlab-sidekiq.service: Consumed 58.457s CPU time over 1min 58.126s wall clock time, 956.5M memory peak, 4.4M read from disk.1479gitlab # [ 191.280696] systemd[1]: Started gitlab-sidekiq.service.1480gitlab # [ 191.283159] setup-gitlab-start[2193]: + mkdir -p /var/lib/secrets1481gitlab # [ 191.286208] setup-gitlab-start[2193]: + echo nixbot-test-token-of-20-chars1482gitlab # [ 191.288403] setup-gitlab-start[2193]: + chmod 644 /var/lib/secrets/gitlab-token1483gitlab # [ 191.290469] setup-gitlab-start[2193]: + timeout 300 bash -c $'until curl -fs -H "PRIVATE-TOKEN: $0" http://gitlab/api/v4/projects/root%2Ftest-flake > /dev/null; do\n curl -s -X POST -H "PRIVATE-TOKEN: $0" -H "Content-Type: application/json" \\\n -d "{\\"name\\":\\"test-flake\\",\\"visibility\\":\\"public\\",\\"topics\\":[\\"build-with-buildbot\\"]}" \\\n http://gitlab/api/v4/projects | jq -c "{id, message, error}"\n sleep 5\ndone' nixbot-test-token-of-20-chars1484gitlab # [ 191.502131] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:09:00 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 404 35 "" "curl/8.21.0" 1811485gitlab # [ 192.018672] gitaly[889]: time="2026-09-13T12:09:01.046Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQECA907F896T13BVB4F9 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-13T12:09:11.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T12:09:01.046" pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1486gitlab # [ 192.020433] gitaly[889]: time="2026-09-13T12:09:01.047Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQECA907F896T13BVB4F9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-13T12:09:11.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T12:09:01.046" grpc.time_ms=0.385 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1487gitlab # [ 192.108510] gitaly[889]: time="2026-09-13T12:09:01.137Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQECA907F896T13BVB4F9 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-13T12:09:11.096" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T12:09:01.137" pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1488gitlab # [ 192.131351] gitaly[889]: time="2026-09-13T12:09:01.160Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQECA907F896T13BVB4F9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-13T12:09:11.096" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T12:09:01.137" grpc.time_ms=0.457 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1489gitlab # [ 192.217829] gitaly[889]: time="2026-09-13T12:09:01.246Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQECA907F896T13BVB4F9 diskcache=cfd76afa-2f09-4068-baa0-8f8f803e1e59 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-13T12:09:11.150" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T12:09:01.191" pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1490gitlab # [ 192.238653] gitaly[889]: time="2026-09-13T12:09:01.267Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1584 command.oublock=32 command.real_time_ms=26 command.spawn_token_fork_ms=1 command.system_time_ms=15 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQECA907F896T13BVB4F9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-13T12:09:11.150" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T12:09:01.191" grpc.time_ms=55.395 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1491gitlab # [ 192.274181] gitaly[889]: time="2026-09-13T12:09:01.303Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQECA907F896T13BVB4F9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-13T12:09:11.261" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T12:09:01.302" pid=889 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1492gitlab # [ 192.275582] gitaly[889]: time="2026-09-13T12:09:01.303Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQECA907F896T13BVB4F9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-13T12:09:11.261" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T12:09:01.302" grpc.time_ms=1.211 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1493gitlab # [ 192.312502] gitaly[889]: time="2026-09-13T12:09:01.341Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQECA907F896T13BVB4F9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-13T12:09:11.289" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T12:09:01.330" grpc.time_ms=11.257 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1494gitlab # [ 192.402926] gitaly[889]: time="2026-09-13T12:09:01.431Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQECA907F896T13BVB4F9 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-13T12:09:11.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T12:09:01.431" pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1495gitlab # [ 192.425443] gitaly[889]: time="2026-09-13T12:09:01.432Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQECA907F896T13BVB4F9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-13T12:09:11.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T12:09:01.431" grpc.time_ms=0.392 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1496gitlab # [ 192.466537] gitaly[889]: time="2026-09-13T12:09:01.495Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQECA907F896T13BVB4F9 diskcache=5e26645e-1317-4685-bba2-cad5f64901a6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-13T12:09:11.025" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T12:09:01.456" pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1497gitlab # [ 192.482393] gitaly[889]: time="2026-09-13T12:09:01.511Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1575 command.oublock=32 command.real_time_ms=15 command.spawn_token_fork_ms=3 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQECA907F896T13BVB4F9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-13T12:09:11.025" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T12:09:01.456" grpc.time_ms=39.658 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1498gitlab # [ 192.503371] gitaly[889]: time="2026-09-13T12:09:01.532Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQECA907F896T13BVB4F9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-13T12:09:11.100" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T12:09:01.531" pid=889 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1499gitlab # [ 192.504698] gitaly[889]: time="2026-09-13T12:09:01.532Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQECA907F896T13BVB4F9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-13T12:09:11.100" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T12:09:01.531" grpc.time_ms=0.96 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1500gitlab # [ 192.540253] gitaly[889]: time="2026-09-13T12:09:01.569Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQECA907F896T13BVB4F9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-13T12:09:11.127" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T12:09:01.557" grpc.time_ms=11.316 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1501gitlab # [ 192.577926] gitaly[889]: time="2026-09-13T12:09:01.607Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQECA907F896T13BVB4F9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-13T12:09:11.176" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T12:09:01.606" grpc.time_ms=0.13 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1502gitlab # [ 192.587789] gitaly[889]: time="2026-09-13T12:09:01.616Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQECA907F896T13BVB4F9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-13T12:09:11.185" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T12:09:01.615" grpc.time_ms=0.523 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1503gitlab # [ 193.128246] gitaly[889]: time="2026-09-13T12:09:02.156Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQECA907F896T13BVB4F9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-13T12:09:12.106" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T12:09:02.147" grpc.time_ms=9.22 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1504gitlab # [ 193.362862] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:09:02 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 18361505gitlab # [ 193.367706] setup-gitlab-start[2479]: {"id":1,"message":null,"error":null}1506gitlab # [ 194.418102] sidekiq-cluster[2467]: {"severity":"INFO","time":"2026-09-13T12:09:03.430Z","message":"Starting cluster with 1 processes"}1507gitlab # [ 198.512392] gitaly[889]: time="2026-09-13T12:09:07.540Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQN2V9PTX1RTCRN2PHNTB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-13T12:09:17.099" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T12:09:07.530" grpc.time_ms=10.037 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1508gitlab # [ 198.554488] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:09:07 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 200 4924 "" "curl/8.21.0" 1611509gitlab # [ 198.561672] setup-gitlab-start[2193]: + mkdir -p /tmp/test-flake1510gitlab # [ 198.565334] setup-gitlab-start[2193]: + cd /tmp/test-flake1511gitlab # [ 198.566023] setup-gitlab-start[2193]: + git init -b master1512gitlab # [ 198.586778] setup-gitlab-start[2552]: Initialized empty Git repository in /tmp/test-flake/.git/1513gitlab # [ 198.589641] setup-gitlab-start[2193]: + git config user.name test1514gitlab # [ 198.590678] setup-gitlab-start[2193]: + git config user.email test@example.com1515gitlab # [ 198.598223] setup-gitlab-start[2193]: + cat1516gitlab # [ 198.601695] setup-gitlab-start[2193]: + git add flake.nix1517gitlab # [ 198.607060] setup-gitlab-start[2193]: + git commit -m 'initial commit'1518gitlab # [ 198.629993] setup-gitlab-start[2557]: [master (root-commit) bac72d1] initial commit1519gitlab # [ 198.630778] setup-gitlab-start[2557]: 1 file changed, 10 insertions(+)1520gitlab # [ 198.631890] setup-gitlab-start[2557]: create mode 100644 flake.nix1521gitlab # [ 198.633033] setup-gitlab-start[2193]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1522gitlab # [ 198.640768] setup-gitlab-start[2193]: + git push -u origin master1523gitlab # [ 198.830779] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:09:07 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 1581524gitlab # [ 198.955842] gitaly[889]: time="2026-09-13T12:09:07.984Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2DAQNGS8R2N46BQA4XXA2R3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:09:07.972" grpc.time_ms=12.408 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1525gitlab # [ 198.957604] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:09:07 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 1201526gitlab # [ 199.452344] gitaly[889]: time="2026-09-13T12:09:08.481Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-13T12:09:18.044" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T12:09:08.474" grpc.time_ms=6.225 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1527gitlab # [ 199.529103] gitaly[889]: time="2026-09-13T12:09:08.557Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=327 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-13T12:09:38.045" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-13T12:09:08.545" grpc.time_ms=11.765 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1528gitlab # [ 199.588252] gitaly[889]: time="2026-09-13T12:09:08.617Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 duration_ms=194ns method=POST pid=889 status=200 url="http://unix/api/v4/internal/allowed"1529gitlab # [ 199.620353] gitaly[889]: time="2026-09-13T12:09:08.649Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 duration_ms=31ns method=POST pid=889 status=200 url="http://unix/api/v4/internal/pre_receive"1530gitlab # [ 199.622741] gitaly[889]: time="2026-09-13T12:09:08.649Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5311 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T12:09:08.420" grpc.time_ms=229.663 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1531gitlab # [ 199.694885] gitaly[889]: time="2026-09-13T12:09:08.723Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T12:09:08.722" grpc.time_ms=1.207 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1532gitlab # [ 199.755116] gitaly[889]: time="2026-09-13T12:09:08.784Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4780 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T12:09:08.782" grpc.time_ms=0.917 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1533gitlab # [ 199.810124] gitaly[889]: time="2026-09-13T12:09:08.839Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T12:09:08.838" grpc.time_ms=0.466 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1534gitlab # [ 199.917468] gitaly[889]: time="2026-09-13T12:09:08.946Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-13T12:09:18.003" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T12:09:08.934" grpc.time_ms=11.584 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1535gitlab # [ 199.972153] gitaly[889]: time="2026-09-13T12:09:09.001Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1571 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=0 command.system_time_ms=12 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-13T12:09:18.048" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:09:08.978" grpc.time_ms=21.792 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1536gitlab # [ 200.010646] gitaly[889]: time="2026-09-13T12:09:09.039Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 duration_ms=144ns method=POST pid=889 status=200 url="http://unix/api/v4/internal/post_receive"1537gitlab # [ 200.012514] gitaly[889]: time="2026-09-13T12:09:09.039Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4805 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T12:09:08.893" grpc.time_ms=146.064 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1538gitlab # [ 200.039539] gitaly[889]: time="2026-09-13T12:09:09.068Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 diskcache=8144e74f-a345-42b1-9d52-763b846b8392 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:09:08.342" pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1539gitlab # [ 200.049683] gitlab-workhorse[825]: time="2026-09-13T12:09:09Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521540gitlab # [ 200.050606] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:09:09 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 10471541gitlab # [ 200.051052] gitaly[889]: time="2026-09-13T12:09:09.068Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=258 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13753 command.oublock=32 command.real_time_ms=715 command.spawn_token_fork_ms=0 command.system_time_ms=165 command.user_time_ms=93 component=gitaly.StreamServerInterceptor correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=684 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:09:08.342" grpc.time_ms=725.884 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1542gitlab # [ 200.066939] setup-gitlab-start[2561]: To http://gitlab/root/test-flake.git1543gitlab # [ 200.067803] setup-gitlab-start[2561]: * [new branch] master -> master1544gitlab # [ 200.073540] setup-gitlab-start[2561]: branch 'master' set up to track 'origin/master'.1545gitlab # [ 200.079865] systemd[1]: Finished setup-gitlab.service.1546gitlab # [ 200.084734] systemd[1]: Starting nixbot CI service...1547gitlab: (finished: waiting for unit setup-gitlab.service, in 200.77 seconds)1548gitlab: waiting for unit nixbot.service1549gitlab # [ 201.290768] nixbot[2640]: {"ts": "2026-09-13T12:09:10.319Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1550gitlab # [ 201.323350] nixbot[2640]: {"ts": "2026-09-13T12:09:10.352Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1551gitlab # [ 201.351672] nixbot[2640]: {"ts": "2026-09-13T12:09:10.380Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1552gitlab # [ 201.356888] nixbot[2640]: {"ts": "2026-09-13T12:09:10.385Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1553gitlab # [ 201.362576] nixbot[2640]: {"ts": "2026-09-13T12:09:10.391Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1554gitlab # [ 201.370642] nixbot[2640]: {"ts": "2026-09-13T12:09:10.399Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1555gitlab # [ 201.376277] nixbot[2640]: {"ts": "2026-09-13T12:09:10.404Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1556gitlab # [ 201.383536] nixbot[2640]: {"ts": "2026-09-13T12:09:10.412Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1557gitlab # [ 201.392242] nixbot[2640]: {"ts": "2026-09-13T12:09:10.421Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1558gitlab # [ 201.397426] nixbot[2640]: {"ts": "2026-09-13T12:09:10.424Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1559gitlab # [ 201.403095] nixbot[2640]: {"ts": "2026-09-13T12:09:10.431Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1560gitlab # [ 201.410983] nixbot[2640]: {"ts": "2026-09-13T12:09:10.439Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1561gitlab # [ 201.416370] nixbot[2640]: {"ts": "2026-09-13T12:09:10.443Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1562gitlab # [ 201.422936] nixbot[2640]: {"ts": "2026-09-13T12:09:10.451Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1563gitlab # [ 201.432431] nixbot[2640]: {"ts": "2026-09-13T12:09:10.461Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1564gitlab # [ 201.440670] nixbot[2640]: {"ts": "2026-09-13T12:09:10.469Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1565gitlab # [ 201.447535] nixbot[2640]: {"ts": "2026-09-13T12:09:10.476Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1566gitlab # [ 201.454491] nixbot[2640]: {"ts": "2026-09-13T12:09:10.483Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1567gitlab # [ 201.465797] nixbot[2640]: {"ts": "2026-09-13T12:09:10.494Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1568gitlab # [ 201.472947] nixbot[2640]: {"ts": "2026-09-13T12:09:10.501Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1569gitlab # [ 201.476558] nixbot[2640]: {"ts": "2026-09-13T12:09:10.505Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1570gitlab # [ 201.489629] nixbot[2640]: {"ts": "2026-09-13T12:09:10.518Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1571gitlab # [ 201.496338] nixbot[2640]: {"ts": "2026-09-13T12:09:10.525Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1572gitlab # [ 201.503546] nixbot[2640]: {"ts": "2026-09-13T12:09:10.532Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1573gitlab # [ 201.510075] nixbot[2640]: {"ts": "2026-09-13T12:09:10.539Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1574gitlab # [ 201.518501] nixbot[2640]: {"ts": "2026-09-13T12:09:10.547Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1575gitlab # [ 201.526277] nixbot[2640]: {"ts": "2026-09-13T12:09:10.555Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1576gitlab # [ 201.529437] nixbot[2640]: {"ts": "2026-09-13T12:09:10.558Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1577gitlab # [ 201.536910] nixbot[2640]: {"ts": "2026-09-13T12:09:10.565Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"}1578gitlab # [ 201.552995] nixbot[2640]: {"ts": "2026-09-13T12:09:10.581Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"}1579gitlab # [ 201.560571] nixbot[2640]: {"ts": "2026-09-13T12:09:10.589Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 30, "migration": "work_retry"}1580gitlab # [ 201.565529] nixbot[2640]: {"ts": "2026-09-13T12:09:10.594Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"}1581gitlab # [ 201.569964] nixbot[2640]: {"ts": "2026-09-13T12:09:10.598Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 32, "migration": "upload_queue"}1582gitlab # [ 201.579367] nixbot[2640]: {"ts": "2026-09-13T12:09:10.608Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 33, "migration": "effect_runs_catchup"}1583gitlab # [ 201.582918] nixbot[2640]: {"ts": "2026-09-13T12:09:10.611Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 34, "migration": "public_badges"}1584gitlab # [ 201.590450] nixbot[2640]: {"ts": "2026-09-13T12:09:10.619Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 35, "migration": "settle_reset_effects"}1585gitlab # [ 201.936152] nixbot[2640]: INFO: Started server process [2640]1586gitlab # [ 201.936989] nixbot[2640]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1587gitlab # [ 201.969924] nixbot[2640]: INFO: ::ffff:127.0.0.1:33336 - "GET /health HTTP/1.1" 200 OK1588gitlab # [ 201.976378] systemd[1]: Started nixbot CI service.1589gitlab # [ 201.984502] systemd[1]: Reached target Multi-User System.1590gitlab # [ 201.986747] systemd[1]: Startup finished in 1.274s (kernel) + 3.669s (initrd) + 3min 17.040s (userspace) = 3min 21.984s.1591gitlab # [ 202.173221] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:09:11 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1991592gitlab # [ 202.175296] nixbot[2640]: {"ts": "2026-09-13T12:09:11.202Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1593gitlab # [ 202.202902] nixbot[2640]: {"ts": "2026-09-13T12:09:11.231Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1594gitlab: (finished: waiting for unit nixbot.service, in 2.10 seconds)1595gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1596gitlab # [ 202.312145] nixbot[2640]: INFO: ::ffff:127.0.0.1:33344 - "GET /health HTTP/1.1" 200 OK1597gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.04 seconds)1598subtest: project discovered and webhook registered1599gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1600gitlab # [ 202.367973] nixbot[2640]: {"ts": "2026-09-13T12:09:11.396Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1601gitlab # [ 202.370246] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:09:11 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1541602gitlab # [ 202.372105] nixbot[2640]: {"ts": "2026-09-13T12:09:11.401Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1603gitlab # [ 202.403185] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:09:11 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 571604gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.09 seconds)1605gitlab # [ 202.600536] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:09:11 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 918 "" "python-httpx/0.28.1" 2231606gitlab # [ 202.602319] nixbot[2640]: {"ts": "2026-09-13T12:09:11.631Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1607gitlab # [ 203.193821] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:09:12 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 5741608gitlab # [ 203.195645] nixbot[2640]: {"ts": "2026-09-13T12:09:12.222Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1609gitlab # [ 203.249398] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:09:12 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "python-httpx/0.28.1" 381610gitlab # [ 203.251484] nixbot[2640]: {"ts": "2026-09-13T12:09:12.279Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1611gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1612gitlab # [ 203.470996] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:09:12 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 918 "" "python-httpx/0.28.1" 2171613gitlab # [ 203.476807] nixbot[2640]: {"ts": "2026-09-13T12:09:12.503Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1614gitlab # [ 203.515428] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:09:12 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "curl/8.21.0" 701615gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.11 seconds)1616(finished: subtest: project discovered and webhook registered, in 1.20 seconds)1617subtest: push delivers the webhook1618gitlab: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails'1619gitlab # [ 203.551685] gitaly[889]: time="2026-09-13T12:09:12.580Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQT22S1DB9WNXNR8Z1D3V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-09-13T12:09:42.058" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:09:12.559" grpc.time_ms=20.442 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1620gitlab # [ 203.573165] gitaly[889]: time="2026-09-13T12:09:12.602Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQT22S1DB9WNXNR8Z1D3V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T12:09:42.100" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:09:12.601" grpc.time_ms=0.842 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1621gitlab # [ 203.590892] gitaly[889]: time="2026-09-13T12:09:12.619Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQT22S1DB9WNXNR8Z1D3V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-09-13T12:09:22.184" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:09:12.614" grpc.time_ms=5.367 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1622gitlab # [ 203.636549] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:09:12 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 1501623gitlab # [ 203.639053] nixbot[2640]: {"ts": "2026-09-13T12:09:12.667Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1624gitlab # [ 203.716345] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:09:12 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 731625gitlab # [ 203.723807] nixbot[2640]: {"ts": "2026-09-13T12:09:12.746Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1626gitlab # [ 203.730787] nixbot[2640]: {"ts": "2026-09-13T12:09:12.753Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1627gitlab # [ 203.842087] gitaly[889]: time="2026-09-13T12:09:12.871Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M2DAQTBFZ77PC6KA14W98NY6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:09:12.857" grpc.time_ms=13.55 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1628gitlab # [ 203.844328] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:09:12 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 561629gitlab # [ 203.995661] gitaly[889]: time="2026-09-13T12:09:13.024Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQTE8G43A9KFTER9PHY7S grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:09:13.011" pid=889 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1630gitlab # [ 203.996968] gitaly[889]: time="2026-09-13T12:09:13.024Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQTE8G43A9KFTER9PHY7S grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:09:13.011" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1631gitlab # [ 203.999599] gitlab-workhorse[825]: time="2026-09-13T12:09:13Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131632gitlab # [ 204.000661] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:09:13 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1231633gitlab # [ 204.001785] gitaly[889]: time="2026-09-13T12:09:13.028Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQTE8G43A9KFTER9PHY7S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:09:13.011" grpc.time_ms=14.299 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1634gitlab # [ 204.126394] gitaly[889]: time="2026-09-13T12:09:13.155Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQTJBEYAZDZ1CT8GGZRSK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:09:13.140" pid=889 remote_ip="2001:db8:1::1" request_sha=9e10bff27ca8a013f257532844a443b3af6ea327 response_bytes=223 span.kind=server system=grpc1635gitlab # [ 204.126879] gitaly[889]: time="2026-09-13T12:09:13.155Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1204 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQTJBEYAZDZ1CT8GGZRSK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:09:13.140" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1636gitlab # [ 204.127997] gitaly[889]: time="2026-09-13T12:09:13.155Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1204 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQTJBEYAZDZ1CT8GGZRSK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:09:13.140" grpc.time_ms=15.575 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1637gitlab # [ 204.168277] gitlab-workhorse[825]: time="2026-09-13T12:09:13Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2231638gitlab # [ 204.168981] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:09:13 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 1611639gitlab # [ 204.244255] gitaly[889]: time="2026-09-13T12:09:13.273Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2DAQTREFNKD47YZ49J9J721 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:09:13.265" grpc.time_ms=7.948 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1640gitlab # [ 204.265595] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:09:13 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 631641gitlab # [ 204.318371] gitaly[889]: time="2026-09-13T12:09:13.347Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQTTHV2SX1ENP4JZWHCQ3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:09:13.339" pid=889 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1642gitlab # [ 204.319147] gitaly[889]: time="2026-09-13T12:09:13.347Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQTTHV2SX1ENP4JZWHCQ3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:09:13.339" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1643gitlab # [ 204.319687] gitaly[889]: time="2026-09-13T12:09:13.348Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQTTHV2SX1ENP4JZWHCQ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:09:13.339" grpc.time_ms=8.596 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1644gitlab # [ 204.320868] gitlab-workhorse[825]: time="2026-09-13T12:09:13Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671645gitlab # [ 204.321740] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:09:13 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 511646gitlab # [ 204.454360] gitaly[889]: time="2026-09-13T12:09:13.483Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2DAQTYSDGETZZ04XM0RKHMT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:09:13.476" grpc.time_ms=7.112 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1647gitlab # [ 204.476859] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:09:13 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 721648gitlab # [ 204.534895] gitaly[889]: time="2026-09-13T12:09:13.563Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQV171H59YN60SQMSAX2K grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:09:13.550" pid=889 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1649gitlab # [ 204.536523] gitaly[889]: time="2026-09-13T12:09:13.564Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1162 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQV171H59YN60SQMSAX2K grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:09:13.550" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1650gitlab # [ 204.550088] gitaly[889]: time="2026-09-13T12:09:13.578Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1162 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQV171H59YN60SQMSAX2K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:09:13.550" grpc.time_ms=28.71 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1651gitlab # [ 204.554152] gitlab-workhorse[825]: time="2026-09-13T12:09:13Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091652gitlab # [ 204.555556] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:09:13 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 711653gitlab # [ 204.654761] gitaly[889]: time="2026-09-13T12:09:13.682Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQV53ECV9QEB80VQ60WMM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T12:09:43.080" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:09:13.681" grpc.time_ms=0.823 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1654gitlab # [ 204.720370] gitaly[889]: time="2026-09-13T12:09:13.749Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2DAQV53ECV9QEB80VQ60WMM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-13T12:09:43.138" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:09:13.738" grpc.time_ms=10.719 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1655gitlab # [ 204.764771] gitaly[889]: time="2026-09-13T12:09:13.793Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2DAQV53ECV9QEB80VQ60WMM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-13T12:09:23.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:09:13.783" grpc.time_ms=9.78 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1656gitlab # [ 204.779180] gitaly[889]: time="2026-09-13T12:09:13.808Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2DAQV53ECV9QEB80VQ60WMM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-13T12:09:23.021" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:09:13.802" grpc.time_ms=5.757 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1657gitlab # [ 204.839934] gitaly[889]: time="2026-09-13T12:09:13.868Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQV53ECV9QEB80VQ60WMM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-13T12:09:23.087" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T12:09:13.868" grpc.time_ms=0.325 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1658gitlab # [ 204.855441] gitaly[889]: time="2026-09-13T12:09:13.884Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=621 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQV53ECV9QEB80VQ60WMM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-13T12:09:23.095" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:09:13.875" grpc.time_ms=8.741 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1659gitlab # [ 204.890318] gitaly[889]: time="2026-09-13T12:09:13.919Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2DAQV53ECV9QEB80VQ60WMM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4149 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T12:09:13.919" grpc.time_ms=0.311 pid=889 span.kind=server system=grpc1660gitlab # [ 204.917081] gitaly[889]: time="2026-09-13T12:09:13.946Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2DAQV53ECV9QEB80VQ60WMM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4151 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T12:09:13.945" grpc.time_ms=0.351 pid=889 span.kind=server system=grpc1661gitlab # [ 204.935618] gitaly[889]: time="2026-09-13T12:09:13.964Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQV53ECV9QEB80VQ60WMM diskcache=6efd4ccf-abca-4aec-8206-21090bdc4f97 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-13T12:09:23.105" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T12:09:13.885" pid=889 ref=refs/keep-around/bac72d168afe7a939ec23c3739098e06047faf9f remote_ip="2001:db8:1::1" revision=bac72d168afe7a939ec23c3739098e06047faf9f span.kind=server system=grpc username=root1662gitlab # [ 204.946308] gitaly[889]: time="2026-09-13T12:09:13.975Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=46 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5357 command.oublock=8 command.real_time_ms=70 command.spawn_token_fork_ms=0 command.system_time_ms=28 command.user_time_ms=18 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQV53ECV9QEB80VQ60WMM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-13T12:09:23.105" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T12:09:13.885" grpc.time_ms=78.927 pid=889 ref=refs/keep-around/bac72d168afe7a939ec23c3739098e06047faf9f remote_ip="2001:db8:1::1" revision=bac72d168afe7a939ec23c3739098e06047faf9f span.kind=server system=grpc username=root1663gitlab # [ 204.962953] gitaly[889]: time="2026-09-13T12:09:13.992Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQV53ECV9QEB80VQ60WMM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T12:09:43.391" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:09:13.991" grpc.time_ms=0.3 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1664gitlab # [ 205.098524] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:09:14 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/bac72d168afe7a939ec23c3739098e06047faf9f HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 4921665gitlab # [ 205.102057] nixbot[2640]: {"ts": "2026-09-13T12:09:14.130Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/bac72d168afe7a939ec23c3739098e06047faf9f \"HTTP/1.1 201 Created\""}1666gitlab # [ 205.112594] nixbot[2640]: {"ts": "2026-09-13T12:09:14.141Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-bac72d168afe-0"}1667gitlab # [ 205.300882] nixbot[2640]: {"ts": "2026-09-13T12:09:14.329Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-bac72d168afe-0", "argv0": "bwrap"}1668gitlab # [ 205.406741] systemd[1]: Started Nix Daemon.1669gitlab # [ 205.466674] nix-daemon[2811]: accepted connection from pid 2806, user nixbot1670gitlab # [ 210.193484] nix-daemon[2811]: accepted connection from pid 2861, user nixbot1671gitlab # [ 210.217487] nix-daemon[2811]: accepted connection from pid 2806, user nixbot1672gitlab # [ 214.520649] nix-daemon[2811]: accepted connection from pid 2806, user nixbot1673gitlab # [ 214.612330] nix-daemon[2811]: accepted connection from pid 2903, user nixbot1674gitlab # [ 214.667266] gitaly[889]: time="2026-09-13T12:09:23.695Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAR4XKP0WVN4YVCP1N6BCF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T12:09:53.093" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:09:23.694" grpc.time_ms=0.859 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1675gitlab # [ 214.712122] gitaly[889]: time="2026-09-13T12:09:23.741Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2DAR4XKP0WVN4YVCP1N6BCF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-13T12:09:33.000" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:09:23.731" grpc.time_ms=9.808 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1676gitlab # [ 214.752871] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:09:23 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/bac72d168afe7a939ec23c3739098e06047faf9f HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 1451677gitlab # [ 214.760185] nixbot[2640]: {"ts": "2026-09-13T12:09:23.788Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/bac72d168afe7a939ec23c3739098e06047faf9f \"HTTP/1.1 201 Created\""}1678gitlab # [ 214.803068] gitaly[889]: time="2026-09-13T12:09:23.832Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAR52MQYCEFRSGPN7MHBXT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T12:09:53.230" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:09:23.831" grpc.time_ms=0.917 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1679gitlab # [ 214.875620] gitaly[889]: time="2026-09-13T12:09:23.904Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M2DAR52MQYCEFRSGPN7MHBXT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-13T12:09:33.111" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:09:23.892" grpc.time_ms=11.778 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1680gitlab # [ 214.977523] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:09:24 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/bac72d168afe7a939ec23c3739098e06047faf9f HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2091681gitlab # [ 214.989067] nixbot[2640]: {"ts": "2026-09-13T12:09:24.017Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/bac72d168afe7a939ec23c3739098e06047faf9f \"HTTP/1.1 201 Created\""}1682gitlab # [ 219.246977] nix-daemon[2811]: accepted connection from pid 2977, user nixbot1683gitlab # [ 219.335531] gitaly[889]: time="2026-09-13T12:09:28.363Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAR9FJ3WPA6J9BM2AMJA75 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T12:09:58.062" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:09:28.362" grpc.time_ms=0.881 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1684gitlab # [ 219.412220] gitaly[889]: time="2026-09-13T12:09:28.441Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2DAR9FJ3WPA6J9BM2AMJA75 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-13T12:09:38.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:09:28.433" grpc.time_ms=7.091 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1685gitlab # [ 219.476113] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:09:28 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/bac72d168afe7a939ec23c3739098e06047faf9f HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1981686gitlab # [ 219.477276] nixbot[2640]: {"ts": "2026-09-13T12:09:28.506Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/bac72d168afe7a939ec23c3739098e06047faf9f \"HTTP/1.1 201 Created\""}1687gitlab # [ 219.752233] gitaly[889]: time="2026-09-13T12:09:28.781Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2DAR9WW9KMPR1S90BBRY9VE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:09:28.767" grpc.time_ms=12.988 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1688gitlab # [ 219.755910] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:09:28 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 511689gitlab # [ 219.812776] gitaly[889]: time="2026-09-13T12:09:28.841Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2DAR9YJ6XF5MRF9YF65B57C grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:09:28.830" pid=889 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1690gitlab # [ 219.814155] gitaly[889]: time="2026-09-13T12:09:28.841Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAR9YJ6XF5MRF9YF65B57C grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:09:28.830" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1691gitlab # [ 219.847496] gitaly[889]: time="2026-09-13T12:09:28.876Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAR9YJ6XF5MRF9YF65B57C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:09:28.830" grpc.time_ms=46.387 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1692gitlab # [ 219.848228] gitlab-workhorse[825]: time="2026-09-13T12:09:28Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671693gitlab # [ 219.848816] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:09:28 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 901694gitlab # [ 219.879841] sidekiq-cluster[2524]: 2026-09-13T12:09:28.908Z pid=2524 tid=xv8 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2524, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>449069056}1695gitlab # [ 219.925404] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:09:28 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 391696gitlab # [ 219.926059] gitaly[889]: time="2026-09-13T12:09:28.954Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2DARA2JJ5DEE9AES7WKRHE9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:09:28.947" grpc.time_ms=6.499 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1697gitlab # [ 219.985297] gitaly[889]: time="2026-09-13T12:09:29.014Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2DARA499S9ES2PAV1REZZPZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:09:29.007" pid=889 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc1698gitlab # [ 219.985934] gitaly[889]: time="2026-09-13T12:09:29.014Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2DARA499S9ES2PAV1REZZPZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:09:29.007" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1699gitlab # [ 220.006452] gitaly[889]: time="2026-09-13T12:09:29.035Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2DARA499S9ES2PAV1REZZPZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:09:29.007" grpc.time_ms=28.213 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1700gitlab # [ 220.019455] gitlab-workhorse[825]: time="2026-09-13T12:09:29Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671701gitlab # [ 220.020109] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:09:29 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 791702gitlab # [ 220.074619] sidekiq-cluster[2524]: W, [2026-09-13T12:09:29.103736 #2524] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1703gitlab # [ 220.113264] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:09:29.142Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1704gitlab # [ 222.069603] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:09:31.097Z","message":"GitLab reliable fetch activated!"}1705gitlab # [ 222.071448] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:09:31.097Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1706gitlab # [ 242.565371] postgres[3210]: [3210] ERROR: relation "table_without_models" does not exist1707gitlab # [ 242.567749] postgres[3210]: [3210] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1708gitlab # [ 245.081796] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:09:54.110Z","message":"Booted Rails 7.2.3.1 application in production environment"}1709gitlab # [ 245.083955] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:09:54.111Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1710gitlab # [ 245.085805] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:09:54.111Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1711gitlab # [ 245.087579] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:09:54.111Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1712gitlab # [ 245.089476] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:09:54.114Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1713gitlab: (finished: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails', in 41.64 seconds)1714gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1715gitlab # [ 245.260731] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:09:54 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 391716gitlab # [ 245.334935] gitaly[889]: time="2026-09-13T12:09:54.363Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2DAS2VQTC0YDAWN4FZY8ZE0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:09:54.350" grpc.time_ms=12.424 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1717gitlab # [ 245.336795] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:09:54 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 681718gitlab # Enumerating objects: 5, done.1719gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1720gitlab # Delta compression using up to 4 threads1721gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1722gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 136.00 KiB/s, done.1723gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1724gitlab # [ 245.579270] gitaly[889]: time="2026-09-13T12:09:54.608Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=330 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2DAS2ZP16WJ1Z0KKHECP0PW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-13T12:10:24.099" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-13T12:09:54.600" grpc.time_ms=7.99 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1725gitlab # [ 245.620446] gitaly[889]: time="2026-09-13T12:09:54.649Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M2DAS2ZP16WJ1Z0KKHECP0PW duration_ms=88ns method=POST pid=889 status=200 url="http://unix/api/v4/internal/allowed"1726gitlab # [ 245.640249] gitaly[889]: time="2026-09-13T12:09:54.669Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M2DAS2ZP16WJ1Z0KKHECP0PW duration_ms=18ns method=POST pid=889 status=200 url="http://unix/api/v4/internal/pre_receive"1727gitlab # [ 245.641029] gitaly[889]: time="2026-09-13T12:09:54.669Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2DAS2ZP16WJ1Z0KKHECP0PW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5311 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T12:09:54.559" grpc.time_ms=109.894 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1728gitlab # [ 245.703861] gitaly[889]: time="2026-09-13T12:09:54.732Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2DAS2ZP16WJ1Z0KKHECP0PW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T12:09:54.731" grpc.time_ms=0.882 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1729gitlab # [ 245.761086] gitaly[889]: time="2026-09-13T12:09:54.790Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2DAS2ZP16WJ1Z0KKHECP0PW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4780 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T12:09:54.787" grpc.time_ms=2.225 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1730gitlab # [ 245.805783] gitaly[889]: time="2026-09-13T12:09:54.834Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2DAS2ZP16WJ1Z0KKHECP0PW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T12:09:54.834" grpc.time_ms=0.618 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1731gitlab # [ 245.896079] gitaly[889]: time="2026-09-13T12:09:54.925Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M2DAS2ZP16WJ1Z0KKHECP0PW duration_ms=60ns method=POST pid=889 status=200 url="http://unix/api/v4/internal/post_receive"1732gitlab # [ 245.897384] gitaly[889]: time="2026-09-13T12:09:54.926Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2DAS2ZP16WJ1Z0KKHECP0PW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4805 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T12:09:54.864" grpc.time_ms=61.806 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1733gitlab # [ 245.936052] gitaly[889]: time="2026-09-13T12:09:54.965Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M2DAS2ZP16WJ1Z0KKHECP0PW diskcache=cc0151f8-eb9d-41eb-841e-53471b9c80f1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:09:54.477" pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1734gitlab # [ 245.947749] gitaly[889]: time="2026-09-13T12:09:54.976Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=241 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=876544 command.minflt=13334 command.oublock=32 command.real_time_ms=476 command.spawn_token_fork_ms=1 command.system_time_ms=149 command.user_time_ms=92 component=gitaly.StreamServerInterceptor correlation_id=01M2DAS2ZP16WJ1Z0KKHECP0PW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:09:54.477" grpc.time_ms=487.506 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1735gitlab # [ 245.960322] gitlab-workhorse[825]: time="2026-09-13T12:09:54Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521736gitlab # [ 245.960987] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:09:54 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 5661737gitlab # To http://gitlab/root/test-flake.git1738gitlab # bac72d1..eb35f43 master -> master1739gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.81 seconds)1740gitlab: must succeed: git -C /tmp/test-flake rev-parse master1741gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1742gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=eb35f4350ed549063682d3800f1c6cb20196620c'1743gitlab # [ 246.043858] nixbot[2640]: INFO: ::ffff:127.0.0.1:53158 - "GET /api/repos/gitlab/root/test-flake/builds?commit=eb35f4350ed549063682d3800f1c6cb20196620c HTTP/1.1" 200 OK1744gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=eb35f4350ed549063682d3800f1c6cb20196620c', in 0.07 seconds)1745gitlab # [ 246.620330] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:09:55.648Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"7aeb0a0787c6cb68af147db7","created_at":"2026-09-13T12:09:01.367Z","trace_propagation_headers":{"sentry-trace":"4be7b2a8443842d4923e8682a9665ef0-7cd0816b6a604777","baggage":"sentry-trace_id=4be7b2a8443842d4923e8682a9665ef0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2DAQECA907F896T13BVB4F9","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:01.411Z","job_size_bytes":2,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-7aeb0a0787c6cb68af147db7: start","job_status":"start","queue_duration_s":54.236864,"scheduling_latency_s":54.236913}1746gitlab # [ 246.846175] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:09:55.874Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"7aeb0a0787c6cb68af147db7","created_at":"2026-09-13T12:09:01.367Z","trace_propagation_headers":{"sentry-trace":"4be7b2a8443842d4923e8682a9665ef0-7cd0816b6a604777","baggage":"sentry-trace_id=4be7b2a8443842d4923e8682a9665ef0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2DAQECA907F896T13BVB4F9","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:01.411Z","job_size_bytes":2,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-7aeb0a0787c6cb68af147db7: done: 0.22627 sec","job_status":"done","queue_duration_s":54.236864,"scheduling_latency_s":54.236913,"redis_calls":25,"redis_duration_s":0.0071719999999999996,"redis_read_bytes":912,"redis_write_bytes":2805,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.004058,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00177,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001344,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":11,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.109773,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.098456089,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.22627,"completed_at":"2026-09-13T12:09:55.874Z","load_balancing_strategy":"primary","db_duration_s":0.047848,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1747gitlab # [ 246.926971] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:09:55.955Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"ceb307e3e5a7d834cacdb958","created_at":"2026-09-13T12:09:01.423Z","trace_propagation_headers":{"sentry-trace":"4be7b2a8443842d4923e8682a9665ef0-7cd0816b6a604777","baggage":"sentry-trace_id=4be7b2a8443842d4923e8682a9665ef0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2DAQECA907F896T13BVB4F9","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:01.427Z","job_size_bytes":2,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-ceb307e3e5a7d834cacdb958: start","job_status":"start","queue_duration_s":54.527662,"scheduling_latency_s":54.527719}1748gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=eb35f4350ed549063682d3800f1c6cb20196620c'1749gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=eb35f4350ed549063682d3800f1c6cb20196620c', in 0.04 seconds)1750gitlab # [ 247.070619] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:09:56.099Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"ceb307e3e5a7d834cacdb958","created_at":"2026-09-13T12:09:01.423Z","trace_propagation_headers":{"sentry-trace":"4be7b2a8443842d4923e8682a9665ef0-7cd0816b6a604777","baggage":"sentry-trace_id=4be7b2a8443842d4923e8682a9665ef0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2DAQECA907F896T13BVB4F9","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:01.427Z","job_size_bytes":2,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-ceb307e3e5a7d834cacdb958: done: 0.143821 sec","job_status":"done","queue_duration_s":54.527662,"scheduling_latency_s":54.527719,"redis_calls":14,"redis_duration_s":0.004709,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000777,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00261,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001322,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.091399,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.093823378,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.143821,"completed_at":"2026-09-13T12:09:56.098Z","load_balancing_strategy":"primary","db_duration_s":0.026656,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1751gitlab # [ 247.074309] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:09:56.102Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"9e77b862731eef3874fcb293","created_at":"2026-09-13T12:09:02.034Z","trace_propagation_headers":{"sentry-trace":"4be7b2a8443842d4923e8682a9665ef0-7cd0816b6a604777","baggage":"sentry-trace_id=4be7b2a8443842d4923e8682a9665ef0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2DAQECA907F896T13BVB4F9","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:02.039Z","job_size_bytes":5,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-9e77b862731eef3874fcb293: start","job_status":"start","queue_duration_s":54.062299,"scheduling_latency_s":54.062333}1752gitlab # [ 247.145196] nixbot[2640]: INFO: ::ffff:127.0.0.1:53170 - "GET /api/repos/gitlab/root/test-flake/builds?commit=eb35f4350ed549063682d3800f1c6cb20196620c HTTP/1.1" 200 OK1753gitlab # [ 247.228284] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:09:56.256Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"9e77b862731eef3874fcb293","created_at":"2026-09-13T12:09:02.034Z","trace_propagation_headers":{"sentry-trace":"4be7b2a8443842d4923e8682a9665ef0-7cd0816b6a604777","baggage":"sentry-trace_id=4be7b2a8443842d4923e8682a9665ef0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2DAQECA907F896T13BVB4F9","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:02.039Z","job_size_bytes":5,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-9e77b862731eef3874fcb293: done: 0.154455 sec","job_status":"done","queue_duration_s":54.062299,"scheduling_latency_s":54.062333,"redis_calls":12,"redis_duration_s":0.0032459999999999998,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001086,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001686,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000474,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.116574,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000296127,"duration_s":0.154455,"completed_at":"2026-09-13T12:09:56.256Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027509,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1754gitlab # [ 247.232382] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:09:56.258Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"69246098e440396593757ac4","created_at":"2026-09-13T12:09:02.082Z","trace_propagation_headers":{"sentry-trace":"4be7b2a8443842d4923e8682a9665ef0-7cd0816b6a604777","baggage":"sentry-trace_id=4be7b2a8443842d4923e8682a9665ef0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2DAQECA907F896T13BVB4F9","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:02.089Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-69246098e440396593757ac4: start","job_status":"start","queue_duration_s":54.169006,"scheduling_latency_s":54.169021}1755gitlab # [ 247.512917] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:09:56.541Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"69246098e440396593757ac4","created_at":"2026-09-13T12:09:02.082Z","trace_propagation_headers":{"sentry-trace":"4be7b2a8443842d4923e8682a9665ef0-7cd0816b6a604777","baggage":"sentry-trace_id=4be7b2a8443842d4923e8682a9665ef0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2DAQECA907F896T13BVB4F9","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:02.089Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-69246098e440396593757ac4: done: 0.283476 sec","job_status":"done","queue_duration_s":54.169006,"scheduling_latency_s":54.169021,"redis_calls":11,"redis_duration_s":0.00284,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000727,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001608,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000505,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.104,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.171,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.171,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.103,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.128896,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000290261,"duration_s":0.283476,"completed_at":"2026-09-13T12:09:56.541Z","load_balancing_strategy":"primary","db_duration_s":0.154863,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1756gitlab # [ 247.516367] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:09:56.542Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"437cd40ff6666c32cc7eecc2","created_at":"2026-09-13T12:09:02.093Z","trace_propagation_headers":{"sentry-trace":"4be7b2a8443842d4923e8682a9665ef0-7cd0816b6a604777","baggage":"sentry-trace_id=4be7b2a8443842d4923e8682a9665ef0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2DAQECA907F896T13BVB4F9","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:02.099Z","job_size_bytes":89,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-437cd40ff6666c32cc7eecc2: start","job_status":"start","queue_duration_s":54.44374,"scheduling_latency_s":54.443756}1757gitlab # [ 247.550727] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:09:56.579Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"437cd40ff6666c32cc7eecc2","created_at":"2026-09-13T12:09:02.093Z","trace_propagation_headers":{"sentry-trace":"4be7b2a8443842d4923e8682a9665ef0-7cd0816b6a604777","baggage":"sentry-trace_id=4be7b2a8443842d4923e8682a9665ef0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2DAQECA907F896T13BVB4F9","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:02.099Z","job_size_bytes":89,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-437cd40ff6666c32cc7eecc2: done: 0.03616 sec","job_status":"done","queue_duration_s":54.44374,"scheduling_latency_s":54.443756,"redis_calls":11,"redis_duration_s":0.004591,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000679,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001583,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002329,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018688,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000881397,"duration_s":0.03616,"completed_at":"2026-09-13T12:09:56.579Z","load_balancing_strategy":"primary","db_duration_s":0.006169,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1758gitlab # [ 247.615502] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:09:56.581Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 bac72d168afe7a939ec23c3739098e06047faf9f refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"c2174a00c008fa9735b987ff","created_at":"2026-09-13T12:09:08.921Z","trace_propagation_headers":{"sentry-trace":"88206fd6d9c44028916196cbcde26756-5d419e4942d9427f","baggage":"sentry-trace_id=88206fd6d9c44028916196cbcde26756,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2DAQNNY1F8D9WKS024ZWNT1","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:09:08.925Z","job_size_bytes":185,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-c2174a00c008fa9735b987ff: start","job_status":"start","queue_duration_s":47.655963,"scheduling_latency_s":47.655997}1759gitlab # [ 247.622865] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:09:56.606Z","message":"changes: \"0000000000000000000000000000000000000000 bac72d168afe7a939ec23c3739098e06047faf9f refs/heads/master\\n\""}1760gitlab # [ 247.625700] gitaly[889]: time="2026-09-13T12:09:56.644Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-13T12:10:06.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:09:56.638" grpc.time_ms=6.281 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1761gitlab # [ 247.673919] gitaly[889]: time="2026-09-13T12:09:56.654Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-13T12:10:06.018" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T12:09:56.648" grpc.time_ms=5.853 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1762gitlab # [ 247.691155] gitaly[889]: time="2026-09-13T12:09:56.720Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=32 command.spawn_token_fork_ms=27 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-13T12:10:06.054" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:09:56.684" grpc.time_ms=35.115 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1763gitlab # [ 247.739639] gitaly[889]: time="2026-09-13T12:09:56.768Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3932 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T12:09:56.768" grpc.time_ms=0.476 pid=889 span.kind=server system=grpc1764gitlab # [ 247.771636] gitaly[889]: time="2026-09-13T12:09:56.800Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3934 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T12:09:56.800" grpc.time_ms=0.462 pid=889 span.kind=server system=grpc1765gitlab # [ 247.793754] gitaly[889]: time="2026-09-13T12:09:56.822Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 diskcache=09d4de1f-5198-489d-8cd3-60d24bb13f02 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-13T12:10:06.110" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T12:09:56.741" pid=889 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1766gitlab # [ 247.803970] gitaly[889]: time="2026-09-13T12:09:56.823Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=61 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5164 command.oublock=8 command.real_time_ms=70 command.spawn_token_fork_ms=0 command.system_time_ms=36 command.user_time_ms=25 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-13T12:10:06.110" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T12:09:56.741" grpc.time_ms=81.746 pid=889 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1767gitlab # [ 247.806764] gitaly[889]: time="2026-09-13T12:09:56.835Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-13T12:10:06.205" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T12:09:56.835" grpc.time_ms=0.175 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1768gitlab # [ 247.843410] gitaly[889]: time="2026-09-13T12:09:56.872Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=943 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-13T12:10:06.229" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:09:56.859" grpc.time_ms=12.54 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1769gitlab # [ 247.968221] gitaly[889]: time="2026-09-13T12:09:56.997Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=339 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-09-13T12:10:26.087" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:09:56.988" grpc.time_ms=9.022 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1770gitlab # [ 248.044637] gitaly[889]: time="2026-09-13T12:09:57.073Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-13T12:10:07.001" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T12:09:57.072" grpc.time_ms=0.607 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1771gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=eb35f4350ed549063682d3800f1c6cb20196620c'1772gitlab # [ 248.081161] gitaly[889]: time="2026-09-13T12:09:57.110Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=343 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-13T12:10:07.030" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-09-13T12:09:57.101" grpc.time_ms=8.53 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1773gitlab # [ 248.114525] gitaly[889]: time="2026-09-13T12:09:57.143Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-13T12:10:07.058" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:09:57.129" grpc.time_ms=14.153 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1774gitlab # [ 248.133278] gitaly[889]: time="2026-09-13T12:09:57.162Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-13T12:10:07.080" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:09:57.150" grpc.time_ms=10.998 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1775gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=eb35f4350ed549063682d3800f1c6cb20196620c', in 0.08 seconds)1776gitlab # [ 248.165634] gitaly[889]: time="2026-09-13T12:09:57.194Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=960 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-13T12:10:27.078" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:09:57.178" grpc.time_ms=15.707 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1777gitlab # [ 248.172423] nixbot[2640]: INFO: ::ffff:127.0.0.1:53174 - "GET /api/repos/gitlab/root/test-flake/builds?commit=eb35f4350ed549063682d3800f1c6cb20196620c HTTP/1.1" 200 OK1778gitlab # [ 248.493635] gitaly[889]: time="2026-09-13T12:09:57.522Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-13T12:10:07.010" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:09:57.520" grpc.time_ms=1.603 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1779gitlab # [ 248.537918] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:09:57.566Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 bac72d168afe7a939ec23c3739098e06047faf9f refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"c2174a00c008fa9735b987ff","created_at":"2026-09-13T12:09:08.921Z","trace_propagation_headers":{"sentry-trace":"88206fd6d9c44028916196cbcde26756-5d419e4942d9427f","baggage":"sentry-trace_id=88206fd6d9c44028916196cbcde26756,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2DAQNNY1F8D9WKS024ZWNT1","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:09:08.925Z","job_size_bytes":185,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-c2174a00c008fa9735b987ff: done: 0.984999 sec","job_status":"done","queue_duration_s":47.655963,"scheduling_latency_s":47.655997,"gitaly_calls":13,"gitaly_duration_s":0.326618,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.041288,"redis_read_bytes":2103,"redis_write_bytes":21748,"redis_cache_calls":15,"redis_cache_duration_s":0.004853,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.006094,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001257,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7836,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003251,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.01421,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.011623,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.054,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.166,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.194,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.054,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.527037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000741156,"exclusive_lock_hold_duration_s":0.025314112,"duration_s":0.984999,"completed_at":"2026-09-13T12:09:57.566Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.094126,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1780gitlab # [ 248.583298] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:09:57.568Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"5131fbe0591054c1ceb98f2a","created_at":"2026-09-13T12:09:14.008Z","trace_propagation_headers":{"sentry-trace":"89b2c2f48e7e41dd903a281151471314-93c8d6c1a8a04f21","baggage":"sentry-trace_id=89b2c2f48e7e41dd903a281151471314,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2DAQV53ECV9QEB80VQ60WMM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:14.014Z","job_size_bytes":65,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-5131fbe0591054c1ceb98f2a: start","job_status":"start","queue_duration_s":43.554396,"scheduling_latency_s":43.554439}1781gitlab # [ 248.629470] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:09:57.657Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"5131fbe0591054c1ceb98f2a","created_at":"2026-09-13T12:09:14.008Z","trace_propagation_headers":{"sentry-trace":"89b2c2f48e7e41dd903a281151471314-93c8d6c1a8a04f21","baggage":"sentry-trace_id=89b2c2f48e7e41dd903a281151471314,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2DAQV53ECV9QEB80VQ60WMM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:14.014Z","job_size_bytes":65,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-5131fbe0591054c1ceb98f2a: done: 0.089026 sec","job_status":"done","queue_duration_s":43.554396,"scheduling_latency_s":43.554439,"redis_calls":16,"redis_duration_s":0.004146,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.00221,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001406,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00053,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039837,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000318476,"duration_s":0.089026,"completed_at":"2026-09-13T12:09:57.657Z","load_balancing_strategy":"primary","db_duration_s":0.041091,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1782gitlab # [ 248.631291] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:09:57.658Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"bf61fd95463e4770cc429f66","created_at":"2026-09-13T12:09:14.014Z","trace_propagation_headers":{"sentry-trace":"89b2c2f48e7e41dd903a281151471314-93c8d6c1a8a04f21","baggage":"sentry-trace_id=89b2c2f48e7e41dd903a281151471314,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2DAQV53ECV9QEB80VQ60WMM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:14.017Z","job_size_bytes":65,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-bf61fd95463e4770cc429f66: start","job_status":"start","queue_duration_s":43.641241,"scheduling_latency_s":43.641255}1783gitlab # [ 248.789871] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:09:57.817Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"bf61fd95463e4770cc429f66","created_at":"2026-09-13T12:09:14.014Z","trace_propagation_headers":{"sentry-trace":"89b2c2f48e7e41dd903a281151471314-93c8d6c1a8a04f21","baggage":"sentry-trace_id=89b2c2f48e7e41dd903a281151471314,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2DAQV53ECV9QEB80VQ60WMM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:14.017Z","job_size_bytes":65,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-bf61fd95463e4770cc429f66: done: 0.158773 sec","job_status":"done","queue_duration_s":43.641241,"scheduling_latency_s":43.641255,"redis_calls":21,"redis_duration_s":0.0049830000000000004,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.002066,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001667,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00125,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.118189,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000440279,"duration_s":0.158773,"completed_at":"2026-09-13T12:09:57.817Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02849,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1784gitlab # [ 248.793777] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:09:57.820Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"084fb155a090a9ba5db73243","created_at":"2026-09-13T12:09:14.109Z","trace_propagation_headers":{"sentry-trace":"89b2c2f48e7e41dd903a281151471314-93c8d6c1a8a04f21","baggage":"sentry-trace_id=89b2c2f48e7e41dd903a281151471314,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2DAQV53ECV9QEB80VQ60WMM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:14.114Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-084fb155a090a9ba5db73243: start","job_status":"start","queue_duration_s":43.706456,"scheduling_latency_s":43.706496}1785gitlab # [ 249.105314] gitaly[889]: time="2026-09-13T12:09:58.133Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2DAQV53ECV9QEB80VQ60WMM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T12:09:58.132" grpc.time_ms=0.687 pid=889 span.kind=server system=grpc1786gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=eb35f4350ed549063682d3800f1c6cb20196620c'1787gitlab # [ 249.165635] gitaly[889]: time="2026-09-13T12:09:58.194Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2DAQV53ECV9QEB80VQ60WMM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T12:09:58.193" grpc.time_ms=0.733 pid=889 span.kind=server system=grpc1788gitlab # [ 249.209964] nixbot[2640]: INFO: ::ffff:127.0.0.1:53190 - "GET /api/repos/gitlab/root/test-flake/builds?commit=eb35f4350ed549063682d3800f1c6cb20196620c HTTP/1.1" 200 OK1789gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=eb35f4350ed549063682d3800f1c6cb20196620c', in 0.04 seconds)1790gitlab # [ 249.223795] gitaly[889]: time="2026-09-13T12:09:58.252Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2DAQV53ECV9QEB80VQ60WMM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T12:09:58.251" grpc.time_ms=0.892 pid=889 span.kind=server system=grpc1791gitlab # [ 249.247451] gitaly[889]: time="2026-09-13T12:09:58.276Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQV53ECV9QEB80VQ60WMM diskcache=8a373d39-79db-4f35-9e14-86714de070e5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-13T12:10:28.086" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:09:58.087" pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1792gitlab # [ 249.248667] gitaly[889]: time="2026-09-13T12:09:58.276Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=216 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7583 command.oublock=0 command.real_time_ms=181 command.spawn_token_fork_ms=1 command.system_time_ms=158 command.user_time_ms=58 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQV53ECV9QEB80VQ60WMM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-13T12:10:28.086" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:09:58.087" grpc.time_ms=189.612 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1793gitlab # [ 249.337570] gitaly[889]: time="2026-09-13T12:09:58.366Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2DAQV53ECV9QEB80VQ60WMM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-13T12:10:28.364" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:09:58.364" grpc.time_ms=1.542 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1794gitlab # [ 249.368662] gitaly[889]: time="2026-09-13T12:09:58.397Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQV53ECV9QEB80VQ60WMM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T12:10:28.395" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:09:58.396" grpc.time_ms=1.195 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1795gitlab # [ 249.401096] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:09:58.429Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"084fb155a090a9ba5db73243","created_at":"2026-09-13T12:09:14.109Z","trace_propagation_headers":{"sentry-trace":"89b2c2f48e7e41dd903a281151471314-93c8d6c1a8a04f21","baggage":"sentry-trace_id=89b2c2f48e7e41dd903a281151471314,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2DAQV53ECV9QEB80VQ60WMM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:14.114Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2524,"job_status":"rescheduled","message":"PipelineProcessWorker JID-084fb155a090a9ba5db73243: rescheduled"}1796gitlab # [ 249.430210] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:09:58.458Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"084fb155a090a9ba5db73243","created_at":"2026-09-13T12:09:14.109Z","trace_propagation_headers":{"sentry-trace":"89b2c2f48e7e41dd903a281151471314-93c8d6c1a8a04f21","baggage":"sentry-trace_id=89b2c2f48e7e41dd903a281151471314,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2DAQV53ECV9QEB80VQ60WMM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:14.114Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-084fb155a090a9ba5db73243: done: 0.638464 sec","job_status":"done","queue_duration_s":43.706456,"scheduling_latency_s":43.706496,"gitaly_calls":3,"gitaly_duration_s":0.222467,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.05051,"redis_read_bytes":460,"redis_write_bytes":29293,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002213,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001325,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.01108,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.004004,"redis_queues_read_bytes":37,"redis_queues_write_bytes":15581,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.026167,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000859,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":165,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000539,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00211,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.129,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.028,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.032,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.099,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.232066,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.47028854200000003,"duration_s":0.638464,"completed_at":"2026-09-13T12:09:58.458Z","load_balancing_strategy":"primary","db_duration_s":0.143124,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1797gitlab # [ 249.480406] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:09:58.508Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","bac72d168afe7a939ec23c3739098e06047faf9f eb35f4350ed549063682d3800f1c6cb20196620c refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"424b367a6aa58c741c979c29","created_at":"2026-09-13T12:09:54.894Z","trace_propagation_headers":{"sentry-trace":"6cac5d707a49447ebf4ecf6fb1184ef6-3fa3c88c73304ee7","baggage":"sentry-trace_id=6cac5d707a49447ebf4ecf6fb1184ef6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2DAS2ZP16WJ1Z0KKHECP0PW","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:09:54.896Z","job_size_bytes":185,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-424b367a6aa58c741c979c29: start","job_status":"start","queue_duration_s":3.61244,"scheduling_latency_s":3.612497}1798gitlab # [ 249.500150] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:09:58.529Z","message":"changes: \"bac72d168afe7a939ec23c3739098e06047faf9f eb35f4350ed549063682d3800f1c6cb20196620c refs/heads/master\\n\""}1799gitlab # [ 249.538921] gitaly[889]: time="2026-09-13T12:09:58.567Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M2DAS2ZP16WJ1Z0KKHECP0PW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-13T12:10:08.047" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:09:58.558" grpc.time_ms=9.644 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1800gitlab # [ 249.557155] gitaly[889]: time="2026-09-13T12:09:58.586Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAS2ZP16WJ1Z0KKHECP0PW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-13T12:10:08.063" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T12:09:58.574" grpc.time_ms=11.958 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1801gitlab # [ 249.565368] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:09:58.593Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"c493291faca8bd10aa265480","created_at":"2026-09-13T12:09:58.590Z","trace_propagation_headers":{"sentry-trace":"6cac5d707a49447ebf4ecf6fb1184ef6-51237f61c6a64d44","baggage":"sentry-trace_id=6cac5d707a49447ebf4ecf6fb1184ef6,sentry-release=Unknown"},"correlation_id":"01M2DAS2ZP16WJ1Z0KKHECP0PW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"88e6753a71b49fc67ca4739f","job_size_bytes":46,"pid":2524,"job_status":"deduplicated","message":"ProjectCacheWorker JID-c493291faca8bd10aa265480: deduplicated: until executing","deduplication.type":"until executing"}1802gitlab # [ 249.596143] gitaly[889]: time="2026-09-13T12:09:58.625Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2DAS2ZP16WJ1Z0KKHECP0PW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-13T12:10:08.102" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:09:58.613" grpc.time_ms=11.824 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1803gitlab # [ 249.616171] gitaly[889]: time="2026-09-13T12:09:58.645Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=655 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M2DAS2ZP16WJ1Z0KKHECP0PW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-09-13T12:10:28.630" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:09:58.630" grpc.time_ms=14.186 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1804gitlab # [ 249.636644] gitaly[889]: time="2026-09-13T12:09:58.665Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=347 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2DAS2ZP16WJ1Z0KKHECP0PW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-13T12:10:08.147" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-09-13T12:09:58.658" grpc.time_ms=7.116 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1805gitlab # [ 249.660881] gitaly[889]: time="2026-09-13T12:09:58.689Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M2DAS2ZP16WJ1Z0KKHECP0PW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-13T12:10:08.168" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:09:58.678" grpc.time_ms=11.257 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1806gitlab # [ 249.759540] gitaly[889]: time="2026-09-13T12:09:58.788Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2DAS2ZP16WJ1Z0KKHECP0PW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-13T12:10:08.275" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:09:58.786" grpc.time_ms=1.472 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1807gitlab # [ 249.790493] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:09:58.817Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","bac72d168afe7a939ec23c3739098e06047faf9f eb35f4350ed549063682d3800f1c6cb20196620c refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"424b367a6aa58c741c979c29","created_at":"2026-09-13T12:09:54.894Z","trace_propagation_headers":{"sentry-trace":"6cac5d707a49447ebf4ecf6fb1184ef6-3fa3c88c73304ee7","baggage":"sentry-trace_id=6cac5d707a49447ebf4ecf6fb1184ef6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2DAS2ZP16WJ1Z0KKHECP0PW","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-13T12:09:54.896Z","job_size_bytes":185,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-424b367a6aa58c741c979c29: done: 0.309162 sec","job_status":"done","queue_duration_s":3.61244,"scheduling_latency_s":3.612497,"gitaly_calls":7,"gitaly_duration_s":0.091267,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.027731,"redis_read_bytes":501,"redis_write_bytes":11940,"redis_cache_calls":9,"redis_cache_duration_s":0.002905,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001301,"redis_queues_read_bytes":9,"redis_queues_write_bytes":5717,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.00339,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.010903,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.009232,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.027,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.027,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.179336,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000998451,"exclusive_lock_hold_duration_s":0.024372372,"duration_s":0.309162,"completed_at":"2026-09-13T12:09:58.817Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.028777,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1808gitlab # [ 249.846081] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:09:58.874Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"88e6753a71b49fc67ca4739f","created_at":"2026-09-13T12:09:56.656Z","trace_propagation_headers":{"sentry-trace":"88206fd6d9c44028916196cbcde26756-940acb44c3d645e0","baggage":"sentry-trace_id=88206fd6d9c44028916196cbcde26756,sentry-release=Unknown"},"correlation_id":"01M2DAQNNY1F8D9WKS024ZWNT1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:56.669Z","job_size_bytes":46,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-88e6753a71b49fc67ca4739f: start","job_status":"start","queue_duration_s":2.204807,"scheduling_latency_s":2.204862}1809gitlab # [ 249.921330] gitaly[889]: time="2026-09-13T12:09:58.950Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-09-13T18:09:58.943" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T12:09:58.944" grpc.time_ms=5.313 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1810gitlab # [ 249.947473] gitaly[889]: time="2026-09-13T12:09:58.976Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=652 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-13T12:10:28.862" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:09:58.963" grpc.time_ms=13.168 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1811gitlab # [ 249.983141] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:09:59.011Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"88e6753a71b49fc67ca4739f","created_at":"2026-09-13T12:09:56.656Z","trace_propagation_headers":{"sentry-trace":"88206fd6d9c44028916196cbcde26756-940acb44c3d645e0","baggage":"sentry-trace_id=88206fd6d9c44028916196cbcde26756,sentry-release=Unknown"},"correlation_id":"01M2DAQNNY1F8D9WKS024ZWNT1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:56.669Z","job_size_bytes":46,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-88e6753a71b49fc67ca4739f: done: 0.1372 sec","job_status":"done","queue_duration_s":2.204807,"scheduling_latency_s":2.204862,"gitaly_calls":2,"gitaly_duration_s":0.025299,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.009796000000000001,"redis_read_bytes":69,"redis_write_bytes":4886,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001812,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000684,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2114,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002228,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.004105,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000967,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.084382,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000498108,"duration_s":0.1372,"completed_at":"2026-09-13T12:09:59.011Z","load_balancing_strategy":"primary","db_duration_s":0.015565,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1812gitlab # [ 250.033932] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:09:59.062Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"908e69d53a638842cc743b1b","created_at":"2026-09-13T12:09:56.679Z","trace_propagation_headers":{"sentry-trace":"88206fd6d9c44028916196cbcde26756-940acb44c3d645e0","baggage":"sentry-trace_id=88206fd6d9c44028916196cbcde26756,sentry-release=Unknown"},"correlation_id":"01M2DAQNNY1F8D9WKS024ZWNT1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:56.682Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-908e69d53a638842cc743b1b: start","job_status":"start","queue_duration_s":2.380042,"scheduling_latency_s":2.380098}1813gitlab # [ 250.108861] gitaly[889]: time="2026-09-13T12:09:59.137Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 diskcache=514ea67f-aa57-4583-9eb6-20b6b998f0a6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-13T18:09:59.102" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:09:59.103" pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1814gitlab # [ 250.110210] gitaly[889]: time="2026-09-13T12:09:59.137Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1282 command.oublock=0 command.real_time_ms=36 command.spawn_token_fork_ms=0 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-13T18:09:59.102" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:09:59.103" grpc.time_ms=34.182 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1815gitlab # [ 250.161227] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:09:59.189Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"908e69d53a638842cc743b1b","created_at":"2026-09-13T12:09:56.679Z","trace_propagation_headers":{"sentry-trace":"88206fd6d9c44028916196cbcde26756-940acb44c3d645e0","baggage":"sentry-trace_id=88206fd6d9c44028916196cbcde26756,sentry-release=Unknown"},"correlation_id":"01M2DAQNNY1F8D9WKS024ZWNT1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:56.682Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-908e69d53a638842cc743b1b: done: 0.127583 sec","job_status":"done","queue_duration_s":2.380042,"scheduling_latency_s":2.380098,"gitaly_calls":1,"gitaly_duration_s":0.037555,"redis_calls":15,"redis_duration_s":0.005403,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000761,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001956,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000946,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00174,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.013,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.027,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.058555,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.087082856,"duration_s":0.127583,"completed_at":"2026-09-13T12:09:59.189Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.020888,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1816gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=eb35f4350ed549063682d3800f1c6cb20196620c'1817gitlab # [ 250.164432] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:09:59.191Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"f149e591d95a9df0396d0223","created_at":"2026-09-13T12:09:56.831Z","trace_propagation_headers":{"sentry-trace":"88206fd6d9c44028916196cbcde26756-940acb44c3d645e0","baggage":"sentry-trace_id=88206fd6d9c44028916196cbcde26756,sentry-release=Unknown"},"correlation_id":"01M2DAQNNY1F8D9WKS024ZWNT1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:56.833Z","job_size_bytes":23,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-f149e591d95a9df0396d0223: start","job_status":"start","queue_duration_s":2.358427,"scheduling_latency_s":2.35846}1818gitlab # [ 250.258929] nixbot[2640]: INFO: ::ffff:127.0.0.1:53192 - "GET /api/repos/gitlab/root/test-flake/builds?commit=eb35f4350ed549063682d3800f1c6cb20196620c HTTP/1.1" 200 OK1819gitlab # [ 250.263274] gitaly[889]: time="2026-09-13T12:09:59.292Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=655 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-13T12:10:29.279" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:09:59.279" grpc.time_ms=12.026 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1820gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=eb35f4350ed549063682d3800f1c6cb20196620c', in 0.06 seconds)1821gitlab # [ 250.278648] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:09:59.307Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"f149e591d95a9df0396d0223","created_at":"2026-09-13T12:09:56.831Z","trace_propagation_headers":{"sentry-trace":"88206fd6d9c44028916196cbcde26756-940acb44c3d645e0","baggage":"sentry-trace_id=88206fd6d9c44028916196cbcde26756,sentry-release=Unknown"},"correlation_id":"01M2DAQNNY1F8D9WKS024ZWNT1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:56.833Z","job_size_bytes":23,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-f149e591d95a9df0396d0223: done: 0.115386 sec","job_status":"done","queue_duration_s":2.358427,"scheduling_latency_s":2.35846,"gitaly_calls":1,"gitaly_duration_s":0.016469,"redis_calls":16,"redis_duration_s":0.005827,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000453,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001457,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.002656,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001261,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.05,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.05,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041596,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.115386,"completed_at":"2026-09-13T12:09:59.307Z","load_balancing_strategy":"primary","db_duration_s":0.049932,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1822gitlab # [ 250.322284] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:09:59.350Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"a6a957970a826d7fceff93d5","created_at":"2026-09-13T12:09:57.400Z","trace_propagation_headers":{"sentry-trace":"88206fd6d9c44028916196cbcde26756-940acb44c3d645e0","baggage":"sentry-trace_id=88206fd6d9c44028916196cbcde26756,sentry-release=Unknown"},"correlation_id":"01M2DAQNNY1F8D9WKS024ZWNT1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9e4827f2d50ce51060d068c6d3007640abc967ffaf1405c2ed1c13853a5b0c8c","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:57.404Z","job_size_bytes":467,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-a6a957970a826d7fceff93d5: start","job_status":"start","queue_duration_s":1.946284,"scheduling_latency_s":1.946344}1823gitlab # [ 250.366890] gitaly[889]: time="2026-09-13T12:09:59.395Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T12:10:29.393" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:09:59.394" grpc.time_ms=1.05 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1824gitlab # [ 250.382180] gitaly[889]: time="2026-09-13T12:09:59.411Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-13T12:10:09.008" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:09:59.399" grpc.time_ms=11.315 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1825gitlab # [ 250.517758] gitaly[889]: time="2026-09-13T12:09:59.546Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-13T12:10:29.544" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:09:59.545" grpc.time_ms=1.176 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1826gitlab # [ 250.549336] gitaly[889]: time="2026-09-13T12:09:59.578Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=32 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-13T12:10:29.573" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:09:59.574" grpc.time_ms=3.752 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1827gitlab # [ 250.622624] gitaly[889]: time="2026-09-13T12:09:59.651Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-13T12:10:09.247" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:09:59.638" grpc.time_ms=13.367 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1828gitlab # [ 251.024483] gitaly[889]: time="2026-09-13T12:10:00.053Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=5 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=5 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=967 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-13T12:10:30.035" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:10:00.035" grpc.time_ms=17.979 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1829gitlab # [ 251.052701] gitaly[889]: time="2026-09-13T12:10:00.081Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=621 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2DAQNNY1F8D9WKS024ZWNT1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-13T12:10:30.067" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:10:00.067" grpc.time_ms=13.859 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1830gitlab # [ 251.107690] sidekiq-cluster[2524]: {"severity":"WARN","time":"2026-09-13T12:10:00.135Z","class":"CreatePipelineWorker","correlation_id":"01M2DAQNNY1F8D9WKS024ZWNT1","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"bac72d168afe7a939ec23c3739098e06047faf9f","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"bac72d168afe7a939ec23c3739098e06047faf9f","ref":"refs/heads/master"},"retry":0}1831gitlab # [ 251.131866] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:00.160Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"a6a957970a826d7fceff93d5","created_at":"2026-09-13T12:09:57.400Z","trace_propagation_headers":{"sentry-trace":"88206fd6d9c44028916196cbcde26756-940acb44c3d645e0","baggage":"sentry-trace_id=88206fd6d9c44028916196cbcde26756,sentry-release=Unknown"},"correlation_id":"01M2DAQNNY1F8D9WKS024ZWNT1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9e4827f2d50ce51060d068c6d3007640abc967ffaf1405c2ed1c13853a5b0c8c","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:57.404Z","job_size_bytes":467,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-a6a957970a826d7fceff93d5: done: 0.809597 sec","job_status":"done","queue_duration_s":1.946284,"scheduling_latency_s":1.946344,"gitaly_calls":7,"gitaly_duration_s":0.134444,"redis_calls":51,"redis_duration_s":0.02601,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.001226,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.005454,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.014525,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.0033,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001505,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.583246,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000528559,"duration_s":0.809597,"completed_at":"2026-09-13T12:10:00.160Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.058441,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1832gitlab # [ 251.198236] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:00.226Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"48ffcdce-2a3b-43dc-a1cd-620427958f6a\"}"],"class":"WebHookWorker","jid":"afb5b888b38496ea11584919","created_at":"2026-09-13T12:09:57.495Z","trace_propagation_headers":{"sentry-trace":"88206fd6d9c44028916196cbcde26756-940acb44c3d645e0","baggage":"sentry-trace_id=88206fd6d9c44028916196cbcde26756,sentry-release=Unknown"},"correlation_id":"01M2DAQNNY1F8D9WKS024ZWNT1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:39701d9152f410162aed6ea3bf40b806bebd6bff9b872348e028dd672afadb4a","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:57.500Z","job_size_bytes":1751,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-afb5b888b38496ea11584919: start","job_status":"start","queue_duration_s":2.725649,"scheduling_latency_s":2.725711}1833gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=eb35f4350ed549063682d3800f1c6cb20196620c'1834gitlab # [ 251.374166] nixbot[2640]: INFO: ::ffff:127.0.0.1:53196 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted1835gitlab # [ 251.376485] nixbot[2640]: INFO: ::ffff:127.0.0.1:53200 - "GET /api/repos/gitlab/root/test-flake/builds?commit=eb35f4350ed549063682d3800f1c6cb20196620c HTTP/1.1" 200 OK1836gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=eb35f4350ed549063682d3800f1c6cb20196620c', in 0.11 seconds)1837gitlab # [ 251.398698] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:00.427Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"48ffcdce-2a3b-43dc-a1cd-620427958f6a\"}"],"class":"WebHookWorker","jid":"afb5b888b38496ea11584919","created_at":"2026-09-13T12:09:57.495Z","trace_propagation_headers":{"sentry-trace":"88206fd6d9c44028916196cbcde26756-940acb44c3d645e0","baggage":"sentry-trace_id=88206fd6d9c44028916196cbcde26756,sentry-release=Unknown"},"correlation_id":"01M2DAQNNY1F8D9WKS024ZWNT1","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:39701d9152f410162aed6ea3bf40b806bebd6bff9b872348e028dd672afadb4a","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:57.500Z","job_size_bytes":1751,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-afb5b888b38496ea11584919: done: 0.20071 sec","job_status":"done","queue_duration_s":2.725649,"scheduling_latency_s":2.725711,"redis_calls":19,"redis_duration_s":0.005131,"redis_read_bytes":32,"redis_write_bytes":5368,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001189,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000498,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3730,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002264,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00118,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.06810279000001174,"cpu_s":0.09802,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000471289,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.20071,"completed_at":"2026-09-13T12:10:00.426Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004912,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1838gitlab # [ 251.467583] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:00.495Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"5f6151b81160ab1d5503454f","created_at":"2026-09-13T12:09:58.063Z","trace_propagation_headers":{"sentry-trace":"89b2c2f48e7e41dd903a281151471314-925ceb7a73b648bc","baggage":"sentry-trace_id=89b2c2f48e7e41dd903a281151471314,sentry-release=Unknown"},"correlation_id":"01M2DAQV53ECV9QEB80VQ60WMM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:58.070Z","job_size_bytes":23,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-5f6151b81160ab1d5503454f: start","job_status":"start","queue_duration_s":2.425101,"scheduling_latency_s":2.425153}1839gitlab # [ 251.534374] gitaly[889]: time="2026-09-13T12:10:00.562Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2DAS8XDA1X3X9VWE4JN7ZGJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:10:00.555" grpc.time_ms=6.977 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1840gitlab # [ 251.536276] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:10:00 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 701841gitlab # [ 251.551681] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:00.580Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"5f6151b81160ab1d5503454f","created_at":"2026-09-13T12:09:58.063Z","trace_propagation_headers":{"sentry-trace":"89b2c2f48e7e41dd903a281151471314-925ceb7a73b648bc","baggage":"sentry-trace_id=89b2c2f48e7e41dd903a281151471314,sentry-release=Unknown"},"correlation_id":"01M2DAQV53ECV9QEB80VQ60WMM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:58.070Z","job_size_bytes":23,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-5f6151b81160ab1d5503454f: done: 0.084786 sec","job_status":"done","queue_duration_s":2.425101,"scheduling_latency_s":2.425153,"redis_calls":10,"redis_duration_s":0.002882,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000587,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001776,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000519,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.062397,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000286349,"duration_s":0.084786,"completed_at":"2026-09-13T12:10:00.580Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014088,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1842gitlab # [ 251.594084] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:00.622Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"66bfb95c3019b9548925e0de","created_at":"2026-09-13T12:09:58.282Z","trace_propagation_headers":{"sentry-trace":"89b2c2f48e7e41dd903a281151471314-925ceb7a73b648bc","baggage":"sentry-trace_id=89b2c2f48e7e41dd903a281151471314,sentry-release=Unknown"},"correlation_id":"01M2DAQV53ECV9QEB80VQ60WMM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:58.286Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-66bfb95c3019b9548925e0de: start","job_status":"start","queue_duration_s":2.336208,"scheduling_latency_s":2.336264}1843gitlab # [ 251.641113] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:00.669Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"66bfb95c3019b9548925e0de","created_at":"2026-09-13T12:09:58.282Z","trace_propagation_headers":{"sentry-trace":"89b2c2f48e7e41dd903a281151471314-925ceb7a73b648bc","baggage":"sentry-trace_id=89b2c2f48e7e41dd903a281151471314,sentry-release=Unknown"},"correlation_id":"01M2DAQV53ECV9QEB80VQ60WMM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:58.286Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-66bfb95c3019b9548925e0de: done: 0.047731 sec","job_status":"done","queue_duration_s":2.336208,"scheduling_latency_s":2.336264,"redis_calls":10,"redis_duration_s":0.005103,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001223,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003138,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000742,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029633,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00091967,"duration_s":0.047731,"completed_at":"2026-09-13T12:10:00.669Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003861,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1844gitlab # [ 251.662992] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:00.671Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"444c63494d45b45adf89c425","created_at":"2026-09-13T12:09:58.295Z","trace_propagation_headers":{"sentry-trace":"89b2c2f48e7e41dd903a281151471314-925ceb7a73b648bc","baggage":"sentry-trace_id=89b2c2f48e7e41dd903a281151471314,sentry-release=Unknown"},"correlation_id":"01M2DAQV53ECV9QEB80VQ60WMM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:58.304Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-444c63494d45b45adf89c425: start","job_status":"start","queue_duration_s":2.367088,"scheduling_latency_s":2.367104}1845gitlab # [ 251.663773] gitlab-workhorse[825]: time="2026-09-13T12:10:00Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671846gitlab # [ 251.664507] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:10:00 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 931847gitlab # [ 251.664988] gitaly[889]: time="2026-09-13T12:10:00.671Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2DAS902HV3ZWBT7YZCVAKN1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:10:00.662" pid=889 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1848gitlab # [ 251.668608] gitaly[889]: time="2026-09-13T12:10:00.671Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAS902HV3ZWBT7YZCVAKN1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:10:00.662" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1849gitlab # [ 251.716908] gitaly[889]: time="2026-09-13T12:10:00.671Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAS902HV3ZWBT7YZCVAKN1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:10:00.662" grpc.time_ms=8.637 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1850gitlab # [ 251.717628] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:00.705Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"444c63494d45b45adf89c425","created_at":"2026-09-13T12:09:58.295Z","trace_propagation_headers":{"sentry-trace":"89b2c2f48e7e41dd903a281151471314-925ceb7a73b648bc","baggage":"sentry-trace_id=89b2c2f48e7e41dd903a281151471314,sentry-release=Unknown"},"correlation_id":"01M2DAQV53ECV9QEB80VQ60WMM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:58.304Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-444c63494d45b45adf89c425: done: 0.034132 sec","job_status":"done","queue_duration_s":2.367088,"scheduling_latency_s":2.367104,"redis_calls":10,"redis_duration_s":0.004374,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000317,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003734,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000323,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022585,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023299,"duration_s":0.034132,"completed_at":"2026-09-13T12:10:00.705Z","load_balancing_strategy":"primary","db_duration_s":0.004253,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1851gitlab # [ 251.767112] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:00.706Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"5bd6bdfd361916afa9dbccec","created_at":"2026-09-13T12:09:58.314Z","trace_propagation_headers":{"sentry-trace":"89b2c2f48e7e41dd903a281151471314-925ceb7a73b648bc","baggage":"sentry-trace_id=89b2c2f48e7e41dd903a281151471314,sentry-release=Unknown"},"correlation_id":"01M2DAQV53ECV9QEB80VQ60WMM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:58.318Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-5bd6bdfd361916afa9dbccec: start","job_status":"start","queue_duration_s":2.388447,"scheduling_latency_s":2.388462}1852gitlab # [ 251.767788] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:00.734Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"5bd6bdfd361916afa9dbccec","created_at":"2026-09-13T12:09:58.314Z","trace_propagation_headers":{"sentry-trace":"89b2c2f48e7e41dd903a281151471314-925ceb7a73b648bc","baggage":"sentry-trace_id=89b2c2f48e7e41dd903a281151471314,sentry-release=Unknown"},"correlation_id":"01M2DAQV53ECV9QEB80VQ60WMM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:58.318Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-5bd6bdfd361916afa9dbccec: done: 0.028072 sec","job_status":"done","queue_duration_s":2.388447,"scheduling_latency_s":2.388462,"redis_calls":13,"redis_duration_s":0.0021709999999999998,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000287,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001037,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000462,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000385,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017358,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000286629,"duration_s":0.028072,"completed_at":"2026-09-13T12:10:00.734Z","load_balancing_strategy":"primary","db_duration_s":0.004295,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1853gitlab # [ 251.818675] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:00.735Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"fa0008c41346bca25e023a25","created_at":"2026-09-13T12:09:58.318Z","trace_propagation_headers":{"sentry-trace":"89b2c2f48e7e41dd903a281151471314-925ceb7a73b648bc","baggage":"sentry-trace_id=89b2c2f48e7e41dd903a281151471314,sentry-release=Unknown"},"correlation_id":"01M2DAQV53ECV9QEB80VQ60WMM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:58.321Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-fa0008c41346bca25e023a25: start","job_status":"start","queue_duration_s":2.414614,"scheduling_latency_s":2.414628}1854gitlab # [ 251.819581] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:00.762Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"fa0008c41346bca25e023a25","created_at":"2026-09-13T12:09:58.318Z","trace_propagation_headers":{"sentry-trace":"89b2c2f48e7e41dd903a281151471314-925ceb7a73b648bc","baggage":"sentry-trace_id=89b2c2f48e7e41dd903a281151471314,sentry-release=Unknown"},"correlation_id":"01M2DAQV53ECV9QEB80VQ60WMM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:58.321Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-fa0008c41346bca25e023a25: done: 0.026728 sec","job_status":"done","queue_duration_s":2.414614,"scheduling_latency_s":2.414628,"redis_calls":10,"redis_duration_s":0.002322,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00038,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001509,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000433,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015932,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031233,"duration_s":0.026728,"completed_at":"2026-09-13T12:10:00.762Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005365,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1855gitlab # [ 251.863746] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:00.763Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"e127e884538b43733ffa1f97","created_at":"2026-09-13T12:09:58.321Z","trace_propagation_headers":{"sentry-trace":"89b2c2f48e7e41dd903a281151471314-925ceb7a73b648bc","baggage":"sentry-trace_id=89b2c2f48e7e41dd903a281151471314,sentry-release=Unknown"},"correlation_id":"01M2DAQV53ECV9QEB80VQ60WMM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:58.325Z","job_size_bytes":19,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-e127e884538b43733ffa1f97: start","job_status":"start","queue_duration_s":2.43887,"scheduling_latency_s":2.438882}1856gitlab # [ 251.864395] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:00.790Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"e127e884538b43733ffa1f97","created_at":"2026-09-13T12:09:58.321Z","trace_propagation_headers":{"sentry-trace":"89b2c2f48e7e41dd903a281151471314-925ceb7a73b648bc","baggage":"sentry-trace_id=89b2c2f48e7e41dd903a281151471314,sentry-release=Unknown"},"correlation_id":"01M2DAQV53ECV9QEB80VQ60WMM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:58.325Z","job_size_bytes":19,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-e127e884538b43733ffa1f97: done: 0.026331 sec","job_status":"done","queue_duration_s":2.43887,"scheduling_latency_s":2.438882,"redis_calls":11,"redis_duration_s":0.0054329999999999995,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000439,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.004625,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000369,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012408,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000333283,"duration_s":0.026331,"completed_at":"2026-09-13T12:10:00.790Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005113,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1857gitlab # [ 251.903607] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:00.791Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"200f344e1aecc9c1fd3a3074","created_at":"2026-09-13T12:09:58.327Z","trace_propagation_headers":{"sentry-trace":"89b2c2f48e7e41dd903a281151471314-925ceb7a73b648bc","baggage":"sentry-trace_id=89b2c2f48e7e41dd903a281151471314,sentry-release=Unknown"},"correlation_id":"01M2DAQV53ECV9QEB80VQ60WMM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:58.330Z","job_size_bytes":66,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-200f344e1aecc9c1fd3a3074: start","job_status":"start","queue_duration_s":2.461636,"scheduling_latency_s":2.461651}1858gitlab # [ 251.942929] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:00.826Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"200f344e1aecc9c1fd3a3074","created_at":"2026-09-13T12:09:58.327Z","trace_propagation_headers":{"sentry-trace":"89b2c2f48e7e41dd903a281151471314-925ceb7a73b648bc","baggage":"sentry-trace_id=89b2c2f48e7e41dd903a281151471314,sentry-release=Unknown"},"correlation_id":"01M2DAQV53ECV9QEB80VQ60WMM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:58.330Z","job_size_bytes":66,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-200f344e1aecc9c1fd3a3074: done: 0.034224 sec","job_status":"done","queue_duration_s":2.461636,"scheduling_latency_s":2.461651,"redis_calls":10,"redis_duration_s":0.003803,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000833,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002515,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000455,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018645,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000912685,"duration_s":0.034224,"completed_at":"2026-09-13T12:10:00.825Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006186,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1859gitlab # [ 251.948741] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:00.828Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"d9b31870283ee072fa18a621","created_at":"2026-09-13T12:09:58.330Z","trace_propagation_headers":{"sentry-trace":"89b2c2f48e7e41dd903a281151471314-925ceb7a73b648bc","baggage":"sentry-trace_id=89b2c2f48e7e41dd903a281151471314,sentry-release=Unknown"},"correlation_id":"01M2DAQV53ECV9QEB80VQ60WMM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:58.333Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-d9b31870283ee072fa18a621: start","job_status":"start","queue_duration_s":2.494867,"scheduling_latency_s":2.49489}1860gitlab # [ 251.990155] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:00.855Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"d9b31870283ee072fa18a621","created_at":"2026-09-13T12:09:58.330Z","trace_propagation_headers":{"sentry-trace":"89b2c2f48e7e41dd903a281151471314-925ceb7a73b648bc","baggage":"sentry-trace_id=89b2c2f48e7e41dd903a281151471314,sentry-release=Unknown"},"correlation_id":"01M2DAQV53ECV9QEB80VQ60WMM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:58.333Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-d9b31870283ee072fa18a621: done: 0.027203 sec","job_status":"done","queue_duration_s":2.494867,"scheduling_latency_s":2.49489,"redis_calls":10,"redis_duration_s":0.001431,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000252,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000881,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000298,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019077,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000243048,"duration_s":0.027203,"completed_at":"2026-09-13T12:10:00.855Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003322,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1861gitlab # [ 252.002877] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:00.856Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"6de7b41f9efdb6480accb3cf","created_at":"2026-09-13T12:09:58.338Z","trace_propagation_headers":{"sentry-trace":"89b2c2f48e7e41dd903a281151471314-925ceb7a73b648bc","baggage":"sentry-trace_id=89b2c2f48e7e41dd903a281151471314,sentry-release=Unknown"},"correlation_id":"01M2DAQV53ECV9QEB80VQ60WMM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:58.340Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-6de7b41f9efdb6480accb3cf: start","job_status":"start","queue_duration_s":2.515885,"scheduling_latency_s":2.515899}1862gitlab # [ 252.018352] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:00.879Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"6de7b41f9efdb6480accb3cf","created_at":"2026-09-13T12:09:58.338Z","trace_propagation_headers":{"sentry-trace":"89b2c2f48e7e41dd903a281151471314-925ceb7a73b648bc","baggage":"sentry-trace_id=89b2c2f48e7e41dd903a281151471314,sentry-release=Unknown"},"correlation_id":"01M2DAQV53ECV9QEB80VQ60WMM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:58.340Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-6de7b41f9efdb6480accb3cf: done: 0.022932 sec","job_status":"done","queue_duration_s":2.515885,"scheduling_latency_s":2.515899,"redis_calls":10,"redis_duration_s":0.00138,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000256,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000788,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000336,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013141,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000203657,"duration_s":0.022932,"completed_at":"2026-09-13T12:10:00.879Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006006,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1863gitlab # [ 252.067160] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:00.880Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"1dd8a9ebe9cc278cf590b5ca","created_at":"2026-09-13T12:09:58.341Z","trace_propagation_headers":{"sentry-trace":"89b2c2f48e7e41dd903a281151471314-925ceb7a73b648bc","baggage":"sentry-trace_id=89b2c2f48e7e41dd903a281151471314,sentry-release=Unknown"},"correlation_id":"01M2DAQV53ECV9QEB80VQ60WMM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:58.343Z","job_size_bytes":6,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-1dd8a9ebe9cc278cf590b5ca: start","job_status":"start","queue_duration_s":2.53687,"scheduling_latency_s":2.536884}1864gitlab # [ 252.107942] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:00.894Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"1dd8a9ebe9cc278cf590b5ca","created_at":"2026-09-13T12:09:58.341Z","trace_propagation_headers":{"sentry-trace":"89b2c2f48e7e41dd903a281151471314-925ceb7a73b648bc","baggage":"sentry-trace_id=89b2c2f48e7e41dd903a281151471314,sentry-release=Unknown"},"correlation_id":"01M2DAQV53ECV9QEB80VQ60WMM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:58.343Z","job_size_bytes":6,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-1dd8a9ebe9cc278cf590b5ca: done: 0.014214 sec","job_status":"done","queue_duration_s":2.53687,"scheduling_latency_s":2.536884,"redis_calls":10,"redis_duration_s":0.001354,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000272,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000793,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000289,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008616,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000217346,"duration_s":0.014214,"completed_at":"2026-09-13T12:10:00.894Z","load_balancing_strategy":"primary","db_duration_s":0.001339,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1865gitlab # [ 252.111738] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:00.895Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"a55c1a445ab0d7448176144c","created_at":"2026-09-13T12:09:58.344Z","trace_propagation_headers":{"sentry-trace":"89b2c2f48e7e41dd903a281151471314-925ceb7a73b648bc","baggage":"sentry-trace_id=89b2c2f48e7e41dd903a281151471314,sentry-release=Unknown"},"correlation_id":"01M2DAQV53ECV9QEB80VQ60WMM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:58.346Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-a55c1a445ab0d7448176144c: start","job_status":"start","queue_duration_s":2.548872,"scheduling_latency_s":2.548885}1866gitlab # [ 252.152066] gitaly[889]: time="2026-09-13T12:10:01.085Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2DAS2ZP16WJ1Z0KKHECP0PW diskcache=10d9464d-65ab-48bc-8da2-1a74282a7aaa grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-13T18:10:01.074" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:10:01.074" pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1867gitlab # [ 252.152898] gitaly[889]: time="2026-09-13T12:10:01.085Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=317 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAS2ZP16WJ1Z0KKHECP0PW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-13T18:10:01.074" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:10:01.074" grpc.time_ms=10.808 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1868gitlab # [ 252.153750] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:00.997Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"a55c1a445ab0d7448176144c","created_at":"2026-09-13T12:09:58.344Z","trace_propagation_headers":{"sentry-trace":"89b2c2f48e7e41dd903a281151471314-925ceb7a73b648bc","baggage":"sentry-trace_id=89b2c2f48e7e41dd903a281151471314,sentry-release=Unknown"},"correlation_id":"01M2DAQV53ECV9QEB80VQ60WMM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:58.346Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-a55c1a445ab0d7448176144c: done: 0.101592 sec","job_status":"done","queue_duration_s":2.548872,"scheduling_latency_s":2.548885,"redis_calls":10,"redis_duration_s":0.001383,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000307,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000815,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000261,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013579,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000209804,"duration_s":0.101592,"completed_at":"2026-09-13T12:10:00.997Z","load_balancing_strategy":"primary","db_duration_s":0.004413,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1869gitlab # [ 252.220974] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:00.998Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"cd3bd07d3ff5cafa131cd26f","created_at":"2026-09-13T12:09:58.352Z","trace_propagation_headers":{"sentry-trace":"89b2c2f48e7e41dd903a281151471314-925ceb7a73b648bc","baggage":"sentry-trace_id=89b2c2f48e7e41dd903a281151471314,sentry-release=Unknown"},"correlation_id":"01M2DAQV53ECV9QEB80VQ60WMM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:58.354Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-cd3bd07d3ff5cafa131cd26f: start","job_status":"start","queue_duration_s":2.64397,"scheduling_latency_s":2.643993}1870gitlab # [ 252.221778] gitaly[889]: time="2026-09-13T12:10:01.112Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAS2ZP16WJ1Z0KKHECP0PW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T12:10:31.111" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:10:01.111" grpc.time_ms=0.627 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1871gitlab # [ 252.222669] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:01.043Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"cd3bd07d3ff5cafa131cd26f","created_at":"2026-09-13T12:09:58.352Z","trace_propagation_headers":{"sentry-trace":"89b2c2f48e7e41dd903a281151471314-925ceb7a73b648bc","baggage":"sentry-trace_id=89b2c2f48e7e41dd903a281151471314,sentry-release=Unknown"},"correlation_id":"01M2DAQV53ECV9QEB80VQ60WMM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:58.354Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-cd3bd07d3ff5cafa131cd26f: done: 0.044845 sec","job_status":"done","queue_duration_s":2.64397,"scheduling_latency_s":2.643993,"redis_calls":14,"redis_duration_s":0.002137,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000287,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000919,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000931,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029511,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000213715,"duration_s":0.044845,"completed_at":"2026-09-13T12:10:01.043Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008901,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1872gitlab # [ 252.268104] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:01.044Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"e7367db2048e2a434827e15d","created_at":"2026-09-13T12:09:58.430Z","trace_propagation_headers":{"sentry-trace":"89b2c2f48e7e41dd903a281151471314-925ceb7a73b648bc","baggage":"sentry-trace_id=89b2c2f48e7e41dd903a281151471314,sentry-release=Unknown"},"correlation_id":"01M2DAQV53ECV9QEB80VQ60WMM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:58.453Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e7367db2048e2a434827e15d: start","job_status":"start","queue_duration_s":2.591768,"scheduling_latency_s":2.591783}1873gitlab # [ 252.268787] gitaly[889]: time="2026-09-13T12:10:01.120Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAS2ZP16WJ1Z0KKHECP0PW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-13T12:10:11.004" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:10:01.115" grpc.time_ms=5.121 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1874gitlab # [ 252.272919] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:01.062Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"e7367db2048e2a434827e15d","created_at":"2026-09-13T12:09:58.430Z","trace_propagation_headers":{"sentry-trace":"89b2c2f48e7e41dd903a281151471314-925ceb7a73b648bc","baggage":"sentry-trace_id=89b2c2f48e7e41dd903a281151471314,sentry-release=Unknown"},"correlation_id":"01M2DAQV53ECV9QEB80VQ60WMM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:58.453Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e7367db2048e2a434827e15d: done: 0.017423 sec","job_status":"done","queue_duration_s":2.591768,"scheduling_latency_s":2.591783,"redis_calls":8,"redis_duration_s":0.001096,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000835,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000261,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012217,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017423,"completed_at":"2026-09-13T12:10:01.062Z","load_balancing_strategy":"primary","db_duration_s":0.002252,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1875gitlab # [ 252.310846] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:01.063Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"8739b87b2bba12be783187f9","created_at":"2026-09-13T12:09:58.602Z","trace_propagation_headers":{"sentry-trace":"6cac5d707a49447ebf4ecf6fb1184ef6-51237f61c6a64d44","baggage":"sentry-trace_id=6cac5d707a49447ebf4ecf6fb1184ef6,sentry-release=Unknown"},"correlation_id":"01M2DAS2ZP16WJ1Z0KKHECP0PW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"908e69d53a638842cc743b1b","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:58.606Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-8739b87b2bba12be783187f9: start","job_status":"start","queue_duration_s":2.457071,"scheduling_latency_s":2.457085}1876gitlab # [ 252.348605] gitaly[889]: time="2026-09-13T12:10:01.146Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2DAS2ZP16WJ1Z0KKHECP0PW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-13T12:10:31.144" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:10:01.145" grpc.time_ms=0.949 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1877gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=eb35f4350ed549063682d3800f1c6cb20196620c'1878gitlab # [ 252.349463] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:01.095Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"8739b87b2bba12be783187f9","created_at":"2026-09-13T12:09:58.602Z","trace_propagation_headers":{"sentry-trace":"6cac5d707a49447ebf4ecf6fb1184ef6-51237f61c6a64d44","baggage":"sentry-trace_id=6cac5d707a49447ebf4ecf6fb1184ef6,sentry-release=Unknown"},"correlation_id":"01M2DAS2ZP16WJ1Z0KKHECP0PW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"908e69d53a638842cc743b1b","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:58.606Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-8739b87b2bba12be783187f9: done: 0.032727 sec","job_status":"done","queue_duration_s":2.457071,"scheduling_latency_s":2.457085,"gitaly_calls":1,"gitaly_duration_s":0.012725,"redis_calls":12,"redis_duration_s":0.001636,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000635,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000379,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000622,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015617,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.020905729,"duration_s":0.032727,"completed_at":"2026-09-13T12:10:01.095Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002728,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1879gitlab # [ 252.390606] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:01.096Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"eebd7afed983c36842c704ca","created_at":"2026-09-13T12:09:58.748Z","trace_propagation_headers":{"sentry-trace":"6cac5d707a49447ebf4ecf6fb1184ef6-51237f61c6a64d44","baggage":"sentry-trace_id=6cac5d707a49447ebf4ecf6fb1184ef6,sentry-release=Unknown"},"correlation_id":"01M2DAS2ZP16WJ1Z0KKHECP0PW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:57d189ead2f2df02673b70235825dcc674938f8845336f95305a0ab15aa5fd9c","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:58.751Z","job_size_bytes":467,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-eebd7afed983c36842c704ca: start","job_status":"start","queue_duration_s":2.345234,"scheduling_latency_s":2.345247}1880gitlab # [ 252.391597] gitaly[889]: time="2026-09-13T12:10:01.151Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=63 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2DAS2ZP16WJ1Z0KKHECP0PW error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-13T12:10:31.148" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:10:01.149" grpc.time_ms=2.296 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1881gitlab # [ 252.407145] gitaly[889]: time="2026-09-13T12:10:01.173Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2DAS2ZP16WJ1Z0KKHECP0PW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-13T12:10:11.056" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:10:01.167" grpc.time_ms=6.494 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1882gitlab # [ 252.419611] gitaly[889]: time="2026-09-13T12:10:01.448Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2DAS932E4FSXBE7ZWCBVRG3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:10:00.815" pid=889 remote_ip="2001:db8:1::1" request_sha=c859a4ebf99fba5520d5b2742b95241bac167fa1 response_bytes=341 span.kind=server system=grpc1883gitlab # [ 252.462933] gitaly[889]: time="2026-09-13T12:10:01.448Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=942080 command.minflt=1189 command.oublock=0 command.real_time_ms=629 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAS932E4FSXBE7ZWCBVRG3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:10:00.815" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1884gitlab # [ 252.463871] gitlab-workhorse[825]: time="2026-09-13T12:10:01Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3411885gitlab # [ 252.464557] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:10:01 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 341 "" "git/2.55.0" 7781886gitlab # [ 252.465101] gitaly[889]: time="2026-09-13T12:10:01.452Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=942080 command.minflt=1189 command.oublock=0 command.real_time_ms=629 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M2DAS932E4FSXBE7ZWCBVRG3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:10:00.815" grpc.time_ms=637.299 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1887gitlab # [ 252.496521] gitaly[889]: time="2026-09-13T12:10:01.512Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=964 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2DAS2ZP16WJ1Z0KKHECP0PW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-13T12:10:31.503" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:10:01.504" grpc.time_ms=8.711 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1888gitlab # [ 252.497115] gitaly[889]: time="2026-09-13T12:10:01.523Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2DAS2ZP16WJ1Z0KKHECP0PW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-13T12:10:31.515" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:10:01.516" grpc.time_ms=7.688 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1889gitlab # [ 252.512552] sidekiq-cluster[2524]: {"severity":"WARN","time":"2026-09-13T12:10:01.541Z","class":"CreatePipelineWorker","correlation_id":"01M2DAS2ZP16WJ1Z0KKHECP0PW","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"bac72d168afe7a939ec23c3739098e06047faf9f","after":"eb35f4350ed549063682d3800f1c6cb20196620c","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"eb35f4350ed549063682d3800f1c6cb20196620c","ref":"refs/heads/master"},"retry":0}1890gitlab # [ 252.518947] nixbot[2640]: INFO: ::ffff:127.0.0.1:53206 - "GET /api/repos/gitlab/root/test-flake/builds?commit=eb35f4350ed549063682d3800f1c6cb20196620c HTTP/1.1" 200 OK1891gitlab # [ 252.520794] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:01.549Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"eebd7afed983c36842c704ca","created_at":"2026-09-13T12:09:58.748Z","trace_propagation_headers":{"sentry-trace":"6cac5d707a49447ebf4ecf6fb1184ef6-51237f61c6a64d44","baggage":"sentry-trace_id=6cac5d707a49447ebf4ecf6fb1184ef6,sentry-release=Unknown"},"correlation_id":"01M2DAS2ZP16WJ1Z0KKHECP0PW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:57d189ead2f2df02673b70235825dcc674938f8845336f95305a0ab15aa5fd9c","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:58.751Z","job_size_bytes":467,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-eebd7afed983c36842c704ca: done: 0.452849 sec","job_status":"done","queue_duration_s":2.345234,"scheduling_latency_s":2.345247,"gitaly_calls":7,"gitaly_duration_s":0.045273,"redis_calls":33,"redis_duration_s":0.005389,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000539,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000791,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.001844,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002215,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.047,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.039,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.352522,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.452849,"completed_at":"2026-09-13T12:10:01.549Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.047074,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1892gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=eb35f4350ed549063682d3800f1c6cb20196620c', in 0.20 seconds)1893gitlab # [ 252.562067] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:01.551Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"bece9cbb-da80-4af5-b021-103ef5e063e4\"}"],"class":"WebHookWorker","jid":"8e70be75b85a9ff6c4b04da8","created_at":"2026-09-13T12:09:58.770Z","trace_propagation_headers":{"sentry-trace":"6cac5d707a49447ebf4ecf6fb1184ef6-51237f61c6a64d44","baggage":"sentry-trace_id=6cac5d707a49447ebf4ecf6fb1184ef6,sentry-release=Unknown"},"correlation_id":"01M2DAS2ZP16WJ1Z0KKHECP0PW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0d8eeec7a2df4adb81dc5770943b040c26c9c8a7d6d6a86424d9daebb7205875","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:58.773Z","job_size_bytes":1749,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-8e70be75b85a9ff6c4b04da8: start","job_status":"start","queue_duration_s":2.778069,"scheduling_latency_s":2.778089}1894gitlab # [ 252.562748] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:01.581Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"bece9cbb-da80-4af5-b021-103ef5e063e4\"}"],"class":"WebHookWorker","jid":"8e70be75b85a9ff6c4b04da8","created_at":"2026-09-13T12:09:58.770Z","trace_propagation_headers":{"sentry-trace":"6cac5d707a49447ebf4ecf6fb1184ef6-51237f61c6a64d44","baggage":"sentry-trace_id=6cac5d707a49447ebf4ecf6fb1184ef6,sentry-release=Unknown"},"correlation_id":"01M2DAS2ZP16WJ1Z0KKHECP0PW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0d8eeec7a2df4adb81dc5770943b040c26c9c8a7d6d6a86424d9daebb7205875","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:58.773Z","job_size_bytes":1749,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-8e70be75b85a9ff6c4b04da8: done: 0.030733 sec","job_status":"done","queue_duration_s":2.778069,"scheduling_latency_s":2.778089,"redis_calls":14,"redis_duration_s":0.002043,"redis_read_bytes":25,"redis_write_bytes":4682,"redis_queues_calls":2,"redis_queues_duration_s":0.000209,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3726,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001129,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000705,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.004972699000006742,"cpu_s":0.018531,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.030733,"completed_at":"2026-09-13T12:10:01.581Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001472,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1895gitlab # [ 252.615333] nixbot[2640]: INFO: ::ffff:127.0.0.1:53210 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted1896gitlab # [ 252.617242] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:01.582Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"281eed1e580c98bd7dcb084d","created_at":"2026-09-13T12:09:58.989Z","trace_propagation_headers":{"sentry-trace":"88206fd6d9c44028916196cbcde26756-fc689265ede948a5","baggage":"sentry-trace_id=88206fd6d9c44028916196cbcde26756,sentry-release=Unknown"},"correlation_id":"01M2DAQNNY1F8D9WKS024ZWNT1","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:58.996Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-281eed1e580c98bd7dcb084d: start","job_status":"start","queue_duration_s":2.586671,"scheduling_latency_s":2.586688}1897gitlab # [ 252.618065] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:01.620Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"281eed1e580c98bd7dcb084d","created_at":"2026-09-13T12:09:58.989Z","trace_propagation_headers":{"sentry-trace":"88206fd6d9c44028916196cbcde26756-fc689265ede948a5","baggage":"sentry-trace_id=88206fd6d9c44028916196cbcde26756,sentry-release=Unknown"},"correlation_id":"01M2DAQNNY1F8D9WKS024ZWNT1","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-13T12:09:58.996Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-281eed1e580c98bd7dcb084d: done: 0.037937 sec","job_status":"done","queue_duration_s":2.586671,"scheduling_latency_s":2.586688,"redis_calls":19,"redis_duration_s":0.003471,"redis_read_bytes":21,"redis_write_bytes":4291,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000524,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000513,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2262,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001263,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001171,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022131,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.005060141,"duration_s":0.037937,"completed_at":"2026-09-13T12:10:01.620Z","load_balancing_strategy":"primary","db_duration_s":0.010181,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1898gitlab # [ 252.649518] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:01.621Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","afb5b888b38496ea11584919"],"class":"WebHooks::LogExecutionWorker","jid":"72d7e64fbd88e362b86317e6","created_at":"2026-09-13T12:10:00.407Z","trace_propagation_headers":{"sentry-trace":"88206fd6d9c44028916196cbcde26756-d19e27e7c8ec4a46","baggage":"sentry-trace_id=88206fd6d9c44028916196cbcde26756,sentry-release=Unknown"},"correlation_id":"01M2DAQNNY1F8D9WKS024ZWNT1","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d941df30c19b0ca6e4382b21fa96e60cc2b0d28e5950c082dd176a27d0d7f3b1","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:00.416Z","job_size_bytes":2593,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-72d7e64fbd88e362b86317e6: start","job_status":"start","queue_duration_s":1.205749,"scheduling_latency_s":1.205764}1899gitlab # [ 252.690598] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:01.658Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","afb5b888b38496ea11584919"],"class":"WebHooks::LogExecutionWorker","jid":"72d7e64fbd88e362b86317e6","created_at":"2026-09-13T12:10:00.407Z","trace_propagation_headers":{"sentry-trace":"88206fd6d9c44028916196cbcde26756-d19e27e7c8ec4a46","baggage":"sentry-trace_id=88206fd6d9c44028916196cbcde26756,sentry-release=Unknown"},"correlation_id":"01M2DAQNNY1F8D9WKS024ZWNT1","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d941df30c19b0ca6e4382b21fa96e60cc2b0d28e5950c082dd176a27d0d7f3b1","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:00.416Z","job_size_bytes":2593,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-72d7e64fbd88e362b86317e6: done: 0.036283 sec","job_status":"done","queue_duration_s":1.205749,"scheduling_latency_s":1.205764,"redis_calls":10,"redis_duration_s":0.006279,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00029,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005129,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00086,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000987835,"duration_s":0.036283,"completed_at":"2026-09-13T12:10:01.658Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006914,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1900gitlab # [ 252.740404] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:01.661Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","8e70be75b85a9ff6c4b04da8"],"class":"WebHooks::LogExecutionWorker","jid":"bf43e45c57fae60af1a503d1","created_at":"2026-09-13T12:10:01.575Z","trace_propagation_headers":{"sentry-trace":"6cac5d707a49447ebf4ecf6fb1184ef6-c53b56fd6f524df5","baggage":"sentry-trace_id=6cac5d707a49447ebf4ecf6fb1184ef6,sentry-release=Unknown"},"correlation_id":"01M2DAS2ZP16WJ1Z0KKHECP0PW","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:575cd660f52e882079da58728d9319b5fb37f84ebcd3d7fd14e18c7217eae001","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:01.577Z","job_size_bytes":2592,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-bf43e45c57fae60af1a503d1: start","job_status":"start","queue_duration_s":0.08376,"scheduling_latency_s":0.083774}1901gitlab # [ 252.741059] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:01.688Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","8e70be75b85a9ff6c4b04da8"],"class":"WebHooks::LogExecutionWorker","jid":"bf43e45c57fae60af1a503d1","created_at":"2026-09-13T12:10:01.575Z","trace_propagation_headers":{"sentry-trace":"6cac5d707a49447ebf4ecf6fb1184ef6-c53b56fd6f524df5","baggage":"sentry-trace_id=6cac5d707a49447ebf4ecf6fb1184ef6,sentry-release=Unknown"},"correlation_id":"01M2DAS2ZP16WJ1Z0KKHECP0PW","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:575cd660f52e882079da58728d9319b5fb37f84ebcd3d7fd14e18c7217eae001","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:01.577Z","job_size_bytes":2592,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-bf43e45c57fae60af1a503d1: done: 0.026598 sec","job_status":"done","queue_duration_s":0.08376,"scheduling_latency_s":0.083774,"redis_calls":7,"redis_duration_s":0.003284,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002568,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000716,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013299,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026598,"completed_at":"2026-09-13T12:10:01.688Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008202,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1902gitlab # [ 252.782176] nixbot[2640]: {"ts": "2026-09-13T12:10:01.711Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}1903gitlab # [ 252.782878] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:01.689Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"4697cb61dc9c47350ef57443","created_at":"2026-09-13T12:10:01.611Z","trace_propagation_headers":{"sentry-trace":"88206fd6d9c44028916196cbcde26756-acf3fdb0a4a64a68","baggage":"sentry-trace_id=88206fd6d9c44028916196cbcde26756,sentry-release=Unknown"},"correlation_id":"01M2DAQNNY1F8D9WKS024ZWNT1","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:01.615Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-4697cb61dc9c47350ef57443: start","job_status":"start","queue_duration_s":0.074329,"scheduling_latency_s":0.074355}1904gitlab # [ 252.783569] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:01.780Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"4697cb61dc9c47350ef57443","created_at":"2026-09-13T12:10:01.611Z","trace_propagation_headers":{"sentry-trace":"88206fd6d9c44028916196cbcde26756-acf3fdb0a4a64a68","baggage":"sentry-trace_id=88206fd6d9c44028916196cbcde26756,sentry-release=Unknown"},"correlation_id":"01M2DAQNNY1F8D9WKS024ZWNT1","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:01.615Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-4697cb61dc9c47350ef57443: done: 0.090762 sec","job_status":"done","queue_duration_s":0.074329,"scheduling_latency_s":0.074355,"redis_calls":11,"redis_duration_s":0.00599,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000347,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003615,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002028,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.011,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049954,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00040899,"duration_s":0.090762,"completed_at":"2026-09-13T12:10:01.780Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.045411,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1905gitlab # [ 252.827220] gitaly[889]: time="2026-09-13T12:10:01.818Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DASA5NTNDQMV65BWF4Q69H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T12:10:31.216" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:10:01.817" grpc.time_ms=0.555 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1906gitlab # [ 252.870811] gitaly[889]: time="2026-09-13T12:10:01.899Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=149 command.spawn_token_fork_ms=144 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2DASA3EE9X1GNMGQBK6F01F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:10:01.748" grpc.time_ms=150.956 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1907gitlab # [ 252.884390] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:10:01 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 2021908gitlab # [ 252.915861] gitaly[889]: time="2026-09-13T12:10:01.944Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2DASA5NTNDQMV65BWF4Q69H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-13T12:10:11.158" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:10:01.938" grpc.time_ms=6.382 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1909gitlab # [ 252.962920] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:01.991Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"a18a4bef8f69d78598b1eeef","created_at":"2026-09-13T12:10:01.985Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-a646234b218c42fd","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:01.988Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a18a4bef8f69d78598b1eeef: start","job_status":"start","queue_duration_s":0.00323,"scheduling_latency_s":0.003264}1910gitlab # [ 252.977629] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:10:02 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/bac72d168afe7a939ec23c3739098e06047faf9f HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 2211911gitlab # [ 252.978285] gitaly[889]: time="2026-09-13T12:10:02.006Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2DASA9WC09FMSNT5RY3FX2G grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:10:01.988" pid=889 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1912gitlab # [ 252.978994] gitaly[889]: time="2026-09-13T12:10:02.007Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DASA9WC09FMSNT5RY3FX2G grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:10:01.988" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1913gitlab # [ 252.979801] gitlab-workhorse[825]: time="2026-09-13T12:10:02Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671914gitlab # [ 252.980510] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:10:02 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 911915gitlab # [ 252.980956] gitaly[889]: time="2026-09-13T12:10:02.008Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DASA9WC09FMSNT5RY3FX2G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:10:01.988" grpc.time_ms=19.464 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1916gitlab # [ 253.017967] nixbot[2640]: {"ts": "2026-09-13T12:10:02.046Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/bac72d168afe7a939ec23c3739098e06047faf9f \"HTTP/1.1 201 Created\""}1917gitlab # [ 253.065770] gitaly[889]: time="2026-09-13T12:10:02.094Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DASAE1549FVTVZFMS7868Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T12:10:32.093" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:10:02.093" grpc.time_ms=0.652 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1918gitlab # [ 253.081917] gitaly[889]: time="2026-09-13T12:10:02.111Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2DASA5NTNDQMV65BWF4Q69H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T12:10:02.110" grpc.time_ms=0.38 pid=889 span.kind=server system=grpc1919gitlab # [ 253.093625] gitaly[889]: time="2026-09-13T12:10:02.122Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2DASAESX5Y5T5FPHB7FGQ7Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:10:02.114" grpc.time_ms=8.324 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1920gitlab # [ 253.094502] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:10:02 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 501921gitlab # [ 253.112750] gitaly[889]: time="2026-09-13T12:10:02.141Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=3 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2DASAE1549FVTVZFMS7868Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-13T12:10:12.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:10:02.121" grpc.time_ms=19.961 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1922gitlab # [ 253.140343] gitaly[889]: time="2026-09-13T12:10:02.169Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2DASA5NTNDQMV65BWF4Q69H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T12:10:02.169" grpc.time_ms=0.416 pid=889 span.kind=server system=grpc1923gitlab # [ 253.146581] gitaly[889]: time="2026-09-13T12:10:02.175Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2DASAGDQX7TMPPZ2SP2NY17 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:10:02.165" pid=889 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=221 span.kind=server system=grpc1924gitlab # [ 253.147466] gitaly[889]: time="2026-09-13T12:10:02.175Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1171 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2DASAGDQX7TMPPZ2SP2NY17 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:10:02.165" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1925gitlab # [ 253.155035] gitaly[889]: time="2026-09-13T12:10:02.176Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1171 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2DASAGDQX7TMPPZ2SP2NY17 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:10:02.165" grpc.time_ms=11.145 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1926gitlab # [ 253.155784] nixbot[2640]: {"ts": "2026-09-13T12:10:02.182Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/bac72d168afe7a939ec23c3739098e06047faf9f \"HTTP/1.1 201 Created\""}1927gitlab # [ 253.156290] gitlab-workhorse[825]: time="2026-09-13T12:10:02Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2211928gitlab # [ 253.156752] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:10:02 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 221 "" "git/2.55.0" 511929gitlab # [ 253.157405] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:10:02 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/bac72d168afe7a939ec23c3739098e06047faf9f HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1331930gitlab # [ 253.205729] gitaly[889]: time="2026-09-13T12:10:02.234Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DASAJGWHWX9TNK8CX4FR2B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T12:10:32.033" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:10:02.234" grpc.time_ms=0.683 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1931gitlab # [ 253.216857] gitaly[889]: time="2026-09-13T12:10:02.246Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2DASA5NTNDQMV65BWF4Q69H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T12:10:02.245" grpc.time_ms=0.39 pid=889 span.kind=server system=grpc1932gitlab # [ 253.235177] gitaly[889]: time="2026-09-13T12:10:02.264Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2DASA5NTNDQMV65BWF4Q69H diskcache=369d60b3-5321-471a-a4f2-fe59cffa020d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-13T12:10:32.074" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:10:02.074" pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1933gitlab # [ 253.244489] gitaly[889]: time="2026-09-13T12:10:02.273Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=74 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7322 command.oublock=0 command.real_time_ms=183 command.spawn_token_fork_ms=0 command.system_time_ms=43 command.user_time_ms=31 component=gitaly.UnaryServerInterceptor correlation_id=01M2DASA5NTNDQMV65BWF4Q69H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-13T12:10:32.074" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:10:02.074" grpc.time_ms=189.93 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1934gitlab # [ 253.256142] gitaly[889]: time="2026-09-13T12:10:02.285Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2DASAJGWHWX9TNK8CX4FR2B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-13T12:10:12.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:10:02.279" grpc.time_ms=6.145 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1935gitlab # [ 253.287657] gitaly[889]: time="2026-09-13T12:10:02.316Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DASAMYXW61QG4PF3HSP6FK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T12:10:32.315" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:10:02.316" grpc.time_ms=0.549 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1936gitlab # [ 253.297489] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:10:02 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/bac72d168afe7a939ec23c3739098e06047faf9f HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1331937gitlab # [ 253.298374] nixbot[2640]: {"ts": "2026-09-13T12:10:02.327Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/bac72d168afe7a939ec23c3739098e06047faf9f \"HTTP/1.1 201 Created\""}1938gitlab # [ 253.315314] gitaly[889]: time="2026-09-13T12:10:02.344Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2DASA5NTNDQMV65BWF4Q69H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-13T12:10:32.342" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:10:02.343" grpc.time_ms=0.831 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1939gitlab # [ 253.317602] gitaly[889]: time="2026-09-13T12:10:02.346Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=650 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2DASAMYXW61QG4PF3HSP6FK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-13T12:10:32.339" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:10:02.339" grpc.time_ms=6.939 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1940gitlab # [ 253.329350] gitaly[889]: time="2026-09-13T12:10:02.358Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2DASAMYXW61QG4PF3HSP6FK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-13T12:10:12.232" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:10:02.353" grpc.time_ms=5.455 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1941gitlab # [ 253.348183] gitaly[889]: time="2026-09-13T12:10:02.375Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2DASAMYXW61QG4PF3HSP6FK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-13T12:10:12.254" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T12:10:02.374" grpc.time_ms=0.179 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1942gitlab # [ 253.355183] gitaly[889]: time="2026-09-13T12:10:02.384Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2DASAMYXW61QG4PF3HSP6FK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-13T12:10:12.258" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:10:02.378" grpc.time_ms=5.7 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1943gitlab # [ 253.378347] gitaly[889]: time="2026-09-13T12:10:02.407Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2DASAQGB1N6580BCDQB0JPC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:10:02.400" grpc.time_ms=7.174 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1944gitlab # [ 253.394205] gitaly[889]: time="2026-09-13T12:10:02.415Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2DASAMYXW61QG4PF3HSP6FK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4149 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T12:10:02.414" grpc.time_ms=0.344 pid=889 span.kind=server system=grpc1945gitlab # [ 253.404641] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:10:02 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 551946gitlab # [ 253.410888] gitaly[889]: time="2026-09-13T12:10:02.440Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2DASAMYXW61QG4PF3HSP6FK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4151 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T12:10:02.439" grpc.time_ms=0.359 pid=889 span.kind=server system=grpc1947gitlab # [ 253.426060] gitaly[889]: time="2026-09-13T12:10:02.454Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2DASAMYXW61QG4PF3HSP6FK diskcache=b9fd7299-e863-4a7b-9564-1a0ee4094251 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-13T12:10:12.266" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T12:10:02.386" pid=889 ref=refs/keep-around/eb35f4350ed549063682d3800f1c6cb20196620c remote_ip="2001:db8:1::1" revision=eb35f4350ed549063682d3800f1c6cb20196620c span.kind=server system=grpc username=root1948gitlab # [ 253.436513] gitaly[889]: time="2026-09-13T12:10:02.455Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=47 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5212 command.oublock=8 command.real_time_ms=62 command.spawn_token_fork_ms=1 command.system_time_ms=27 command.user_time_ms=20 component=gitaly.UnaryServerInterceptor correlation_id=01M2DASAMYXW61QG4PF3HSP6FK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-13T12:10:12.266" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-13T12:10:02.386" grpc.time_ms=68.605 pid=889 ref=refs/keep-around/eb35f4350ed549063682d3800f1c6cb20196620c remote_ip="2001:db8:1::1" revision=eb35f4350ed549063682d3800f1c6cb20196620c span.kind=server system=grpc username=root1949gitlab # [ 253.449753] gitlab-workhorse[825]: time="2026-09-13T12:10:02Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671950gitlab # [ 253.451603] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:10:02 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 481951gitlab # [ 253.453769] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:02.474Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"b126c84ddfdba8506a74a97a","created_at":"2026-09-13T12:10:02.472Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-a1b5f362d90f42fa","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","duplicate-of":"a18a4bef8f69d78598b1eeef","job_size_bytes":3,"pid":2524,"job_status":"deduplicated","message":"PipelineProcessWorker JID-b126c84ddfdba8506a74a97a: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}1952gitlab # [ 253.468044] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:02.475Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"a18a4bef8f69d78598b1eeef","created_at":"2026-09-13T12:10:01.985Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-a646234b218c42fd","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:01.988Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2524,"job_status":"rescheduled","message":"PipelineProcessWorker JID-a18a4bef8f69d78598b1eeef: rescheduled"}1953gitlab # [ 253.481562] gitaly[889]: time="2026-09-13T12:10:02.457Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2DASAS96HE1RG8VMCQEMWPS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:10:02.449" pid=889 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1954gitlab # [ 253.491146] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:02.480Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"a18a4bef8f69d78598b1eeef","created_at":"2026-09-13T12:10:01.985Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-a646234b218c42fd","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:01.988Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a18a4bef8f69d78598b1eeef: done: 0.489064 sec","job_status":"done","queue_duration_s":0.00323,"scheduling_latency_s":0.003264,"gitaly_calls":3,"gitaly_duration_s":0.291699,"redis_calls":70,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.012342,"redis_read_bytes":227,"redis_write_bytes":18551,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000412,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000909,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.003207,"redis_queues_read_bytes":24,"redis_queues_write_bytes":12312,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.005047,"redis_queues_metadata_read_bytes":110,"redis_queues_metadata_write_bytes":3546,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000312,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000407,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001636,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.047,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.027,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.027,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.033,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.11011,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.451199803,"duration_s":0.489064,"completed_at":"2026-09-13T12:10:02.480Z","load_balancing_strategy":"primary","db_duration_s":0.069445,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1955gitlab # [ 253.538331] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:02.481Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"d199e4739131932bcc26ce86","created_at":"2026-09-13T12:10:02.067Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-a1b5f362d90f42fa","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:02.069Z","job_size_bytes":23,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-d199e4739131932bcc26ce86: start","job_status":"start","queue_duration_s":0.412037,"scheduling_latency_s":0.41206}1956gitlab # [ 253.538843] gitaly[889]: time="2026-09-13T12:10:02.457Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DASAS96HE1RG8VMCQEMWPS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:10:02.449" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1957gitlab # [ 253.539842] nixbot[2640]: {"ts": "2026-09-13T12:10:02.528Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/eb35f4350ed549063682d3800f1c6cb20196620c \"HTTP/1.1 201 Created\""}1958gitlab # [ 253.540445] nixbot[2640]: {"ts": "2026-09-13T12:10:02.537Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-eb35f4350ed5-4"}1959gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=eb35f4350ed549063682d3800f1c6cb20196620c'1960gitlab # [ 253.540912] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:02.518Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"d199e4739131932bcc26ce86","created_at":"2026-09-13T12:10:02.067Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-a1b5f362d90f42fa","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:02.069Z","job_size_bytes":23,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-d199e4739131932bcc26ce86: done: 0.037158 sec","job_status":"done","queue_duration_s":0.412037,"scheduling_latency_s":0.41206,"redis_calls":7,"redis_duration_s":0.00274,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002382,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000358,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025118,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037158,"completed_at":"2026-09-13T12:10:02.518Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00727,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1961gitlab # [ 253.594176] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:02.520Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"f54b764c986ccd42b2eca74a","created_at":"2026-09-13T12:10:02.303Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-a1b5f362d90f42fa","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:02.307Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-f54b764c986ccd42b2eca74a: start","job_status":"start","queue_duration_s":0.213122,"scheduling_latency_s":0.213145}1962gitlab # [ 253.594863] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:10:02 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/eb35f4350ed549063682d3800f1c6cb20196620c HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 2571963gitlab # [ 253.595540] gitaly[889]: time="2026-09-13T12:10:02.458Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DASAS96HE1RG8VMCQEMWPS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-13T12:10:02.449" grpc.time_ms=8.42 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc1964gitlab # [ 253.597521] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:02.544Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"f54b764c986ccd42b2eca74a","created_at":"2026-09-13T12:10:02.303Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-a1b5f362d90f42fa","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:02.307Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-f54b764c986ccd42b2eca74a: done: 0.024397 sec","job_status":"done","queue_duration_s":0.213122,"scheduling_latency_s":0.213145,"redis_calls":7,"redis_duration_s":0.001142,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000798,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000344,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024397,"completed_at":"2026-09-13T12:10:02.544Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004006,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1965gitlab # [ 253.636170] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:02.545Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"e4ff33594c259bfc189d5f66","created_at":"2026-09-13T12:10:02.313Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-a1b5f362d90f42fa","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:02.315Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-e4ff33594c259bfc189d5f66: start","job_status":"start","queue_duration_s":0.229899,"scheduling_latency_s":0.229921}1966gitlab # [ 253.648709] nixbot[2640]: {"ts": "2026-09-13T12:10:02.625Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-eb35f4350ed5-4", "argv0": "bwrap"}1967gitlab # [ 253.650754] gitaly[889]: time="2026-09-13T12:10:02.459Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DASAMYXW61QG4PF3HSP6FK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T12:10:32.457" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:10:02.458" grpc.time_ms=0.469 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1968gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=eb35f4350ed549063682d3800f1c6cb20196620c', in 0.13 seconds)1969(finished: subtest: push delivers the webhook, in 50.20 seconds)1970subtest: eval and build post commit statuses1971gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/eb35f4350ed549063682d3800f1c6cb20196620c/statuses1972gitlab # [ 253.662296] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:02.566Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"e4ff33594c259bfc189d5f66","created_at":"2026-09-13T12:10:02.313Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-a1b5f362d90f42fa","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:02.315Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-e4ff33594c259bfc189d5f66: done: 0.021203 sec","job_status":"done","queue_duration_s":0.229899,"scheduling_latency_s":0.229921,"redis_calls":7,"redis_duration_s":0.00121,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000864,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000346,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013875,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021203,"completed_at":"2026-09-13T12:10:02.566Z","load_balancing_strategy":"primary","db_duration_s":0.003472,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1973gitlab # [ 253.714583] gitaly[889]: time="2026-09-13T12:10:02.466Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DASA5NTNDQMV65BWF4Q69H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T12:10:32.464" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:10:02.465" grpc.time_ms=0.906 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1974gitlab # [ 253.715973] nixbot[2640]: INFO: ::ffff:127.0.0.1:34630 - "GET /api/repos/gitlab/root/test-flake/builds?commit=eb35f4350ed549063682d3800f1c6cb20196620c HTTP/1.1" 200 OK1975gitlab # [ 253.716697] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:02.734Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"0b992d199c4ad7dfd4bb8646","created_at":"2026-09-13T12:10:02.322Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-a1b5f362d90f42fa","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:02.323Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-0b992d199c4ad7dfd4bb8646: start","job_status":"start","queue_duration_s":0.410374,"scheduling_latency_s":0.410411}1976gitlab # [ 253.766667] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:02.795Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"0b992d199c4ad7dfd4bb8646","created_at":"2026-09-13T12:10:02.322Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-a1b5f362d90f42fa","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:02.323Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-0b992d199c4ad7dfd4bb8646: done: 0.061551 sec","job_status":"done","queue_duration_s":0.410374,"scheduling_latency_s":0.410411,"redis_calls":10,"redis_duration_s":0.010069,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.007892,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001424,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000753,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021587,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.061551,"completed_at":"2026-09-13T12:10:02.795Z","load_balancing_strategy":"primary","db_duration_s":0.025466,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1977gitlab # [ 253.767808] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:02.796Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"55bda0ea2be858022b6456e2","created_at":"2026-09-13T12:10:02.324Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-a1b5f362d90f42fa","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:02.325Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-55bda0ea2be858022b6456e2: start","job_status":"start","queue_duration_s":0.471813,"scheduling_latency_s":0.471831}1978gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/eb35f4350ed549063682d3800f1c6cb20196620c/statuses, in 0.10 seconds)1979gitlab # [ 253.794244] gitaly[889]: time="2026-09-13T12:10:02.823Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DASB4EEB0S8T2030CGDNB6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T12:10:32.222" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:10:02.822" grpc.time_ms=0.543 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1980gitlab # [ 253.796218] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:02.825Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"55bda0ea2be858022b6456e2","created_at":"2026-09-13T12:10:02.324Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-a1b5f362d90f42fa","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:02.325Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-55bda0ea2be858022b6456e2: done: 0.028315 sec","job_status":"done","queue_duration_s":0.471813,"scheduling_latency_s":0.471831,"redis_calls":7,"redis_duration_s":0.001815,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001559,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000256,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012352,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028315,"completed_at":"2026-09-13T12:10:02.825Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01152,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1981gitlab # [ 253.836488] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:02.827Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"254af6868e89074a44f14488","created_at":"2026-09-13T12:10:02.325Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-a1b5f362d90f42fa","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:02.326Z","job_size_bytes":19,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-254af6868e89074a44f14488: start","job_status":"start","queue_duration_s":0.50016,"scheduling_latency_s":0.500177}1982gitlab # [ 253.845184] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:02.842Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"254af6868e89074a44f14488","created_at":"2026-09-13T12:10:02.325Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-a1b5f362d90f42fa","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:02.326Z","job_size_bytes":19,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-254af6868e89074a44f14488: done: 0.01591 sec","job_status":"done","queue_duration_s":0.50016,"scheduling_latency_s":0.500177,"redis_calls":8,"redis_duration_s":0.00168,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000929,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000751,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009749,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01591,"completed_at":"2026-09-13T12:10:02.842Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002175,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1983gitlab # [ 253.889272] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:10:02 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/eb35f4350ed549063682d3800f1c6cb20196620c/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 811984gitlab # [ 253.889975] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:02.843Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"275c8bea680160a1dc9bfba9","created_at":"2026-09-13T12:10:02.327Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-a1b5f362d90f42fa","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:02.328Z","job_size_bytes":66,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-275c8bea680160a1dc9bfba9: start","job_status":"start","queue_duration_s":0.515204,"scheduling_latency_s":0.515219}1985gitlab # [ 253.930182] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:02.862Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"275c8bea680160a1dc9bfba9","created_at":"2026-09-13T12:10:02.327Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-a1b5f362d90f42fa","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:02.328Z","job_size_bytes":66,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-275c8bea680160a1dc9bfba9: done: 0.01898 sec","job_status":"done","queue_duration_s":0.515204,"scheduling_latency_s":0.515219,"redis_calls":7,"redis_duration_s":0.001164,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000839,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000325,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013362,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01898,"completed_at":"2026-09-13T12:10:02.862Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001837,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1986gitlab # [ 253.970071] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:02.864Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"a29a8a65d719dcb50e84cc4a","created_at":"2026-09-13T12:10:02.328Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-a1b5f362d90f42fa","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:02.329Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-a29a8a65d719dcb50e84cc4a: start","job_status":"start","queue_duration_s":0.534121,"scheduling_latency_s":0.534142}1987gitlab # [ 253.970679] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:02.883Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"a29a8a65d719dcb50e84cc4a","created_at":"2026-09-13T12:10:02.328Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-a1b5f362d90f42fa","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:02.329Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-a29a8a65d719dcb50e84cc4a: done: 0.019761 sec","job_status":"done","queue_duration_s":0.534121,"scheduling_latency_s":0.534142,"redis_calls":7,"redis_duration_s":0.001134,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000786,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000348,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012274,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019761,"completed_at":"2026-09-13T12:10:02.883Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004201,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1988gitlab # [ 254.020809] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:02.884Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"0aed749b3d4426a316a45756","created_at":"2026-09-13T12:10:02.330Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-a1b5f362d90f42fa","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:02.331Z","job_size_bytes":6,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-0aed749b3d4426a316a45756: start","job_status":"start","queue_duration_s":0.553575,"scheduling_latency_s":0.553591}1989gitlab # [ 254.021703] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:02.895Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"0aed749b3d4426a316a45756","created_at":"2026-09-13T12:10:02.330Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-a1b5f362d90f42fa","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:02.331Z","job_size_bytes":6,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-0aed749b3d4426a316a45756: done: 0.010381 sec","job_status":"done","queue_duration_s":0.553575,"scheduling_latency_s":0.553591,"redis_calls":7,"redis_duration_s":0.00108,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000787,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000293,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006758,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010381,"completed_at":"2026-09-13T12:10:02.895Z","load_balancing_strategy":"primary","db_duration_s":0.000339,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1990gitlab # [ 254.074224] gitaly[889]: time="2026-09-13T12:10:03.042Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2DASA5NTNDQMV65BWF4Q69H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T12:10:03.040" grpc.time_ms=2.586 pid=889 span.kind=server system=grpc1991gitlab # [ 254.074834] gitaly[889]: time="2026-09-13T12:10:03.063Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2DASA5NTNDQMV65BWF4Q69H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T12:10:03.062" grpc.time_ms=0.598 pid=889 span.kind=server system=grpc1992gitlab # [ 254.075696] nix-daemon[2811]: accepted connection from pid 3640, user nixbot1993gitlab # [ 254.076524] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:02.896Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"9fe52b77e7ff02b5004989d5","created_at":"2026-09-13T12:10:02.331Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-a1b5f362d90f42fa","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:02.332Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-9fe52b77e7ff02b5004989d5: start","job_status":"start","queue_duration_s":0.563793,"scheduling_latency_s":0.563813}1994gitlab # [ 254.081018] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:02.911Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"9fe52b77e7ff02b5004989d5","created_at":"2026-09-13T12:10:02.331Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-a1b5f362d90f42fa","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:02.332Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-9fe52b77e7ff02b5004989d5: done: 0.015641 sec","job_status":"done","queue_duration_s":0.563793,"scheduling_latency_s":0.563813,"redis_calls":7,"redis_duration_s":0.00105,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000766,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000284,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010571,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015641,"completed_at":"2026-09-13T12:10:02.911Z","load_balancing_strategy":"primary","db_duration_s":0.002214,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1995gitlab # [ 254.138754] gitaly[889]: time="2026-09-13T12:10:03.083Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2DASA5NTNDQMV65BWF4Q69H grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T12:10:03.082" grpc.time_ms=0.528 pid=889 span.kind=server system=grpc1996gitlab # [ 254.139644] gitaly[889]: time="2026-09-13T12:10:03.086Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M2DASA5NTNDQMV65BWF4Q69H forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-13T12:10:33.018" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:10:03.018" operations="[repack_refs]" pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1997gitlab # [ 254.140511] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:02.912Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"40495e946a82cce4fa2c32d3","created_at":"2026-09-13T12:10:02.461Z","trace_propagation_headers":{"sentry-trace":"ce2c215809a74df7a2cee000e59aaf28-a768d0fd68104300","baggage":"sentry-trace_id=ce2c215809a74df7a2cee000e59aaf28,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2DASAMYXW61QG4PF3HSP6FK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:02.463Z","job_size_bytes":65,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-40495e946a82cce4fa2c32d3: start","job_status":"start","queue_duration_s":0.44934,"scheduling_latency_s":0.449355}1998gitlab # [ 254.151781] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:02.930Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"40495e946a82cce4fa2c32d3","created_at":"2026-09-13T12:10:02.461Z","trace_propagation_headers":{"sentry-trace":"ce2c215809a74df7a2cee000e59aaf28-a768d0fd68104300","baggage":"sentry-trace_id=ce2c215809a74df7a2cee000e59aaf28,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2DASAMYXW61QG4PF3HSP6FK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:02.463Z","job_size_bytes":65,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-40495e946a82cce4fa2c32d3: done: 0.01774 sec","job_status":"done","queue_duration_s":0.44934,"scheduling_latency_s":0.449355,"redis_calls":7,"redis_duration_s":0.001001,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000735,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000266,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01774,"completed_at":"2026-09-13T12:10:02.930Z","load_balancing_strategy":"primary","db_duration_s":0.002893,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1999gitlab # [ 254.208894] gitaly[889]: time="2026-09-13T12:10:03.088Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M2DASA5NTNDQMV65BWF4Q69H grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-13T12:10:33.018" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:10:03.018" pid=889 remote_ip="2001:db8:1::1" repository_info="{false {6 703 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-09-13 12:09:01.222885988 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2000gitlab # [ 254.209694] gitaly[889]: time="2026-09-13T12:10:03.093Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2DASA5NTNDQMV65BWF4Q69H diskcache=19698665-a1e2-4c96-b07a-9d89817d928d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-13T12:10:33.018" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:10:03.018" pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2001gitlab # [ 254.210691] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:02.931Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"e3e13f3f97e06cc25c585f9a","created_at":"2026-09-13T12:10:02.464Z","trace_propagation_headers":{"sentry-trace":"ce2c215809a74df7a2cee000e59aaf28-a768d0fd68104300","baggage":"sentry-trace_id=ce2c215809a74df7a2cee000e59aaf28,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2DASAMYXW61QG4PF3HSP6FK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:02.465Z","job_size_bytes":65,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-e3e13f3f97e06cc25c585f9a: start","job_status":"start","queue_duration_s":0.465509,"scheduling_latency_s":0.465524}2002gitlab # [ 254.226901] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:02.968Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"e3e13f3f97e06cc25c585f9a","created_at":"2026-09-13T12:10:02.464Z","trace_propagation_headers":{"sentry-trace":"ce2c215809a74df7a2cee000e59aaf28-a768d0fd68104300","baggage":"sentry-trace_id=ce2c215809a74df7a2cee000e59aaf28,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2DASAMYXW61QG4PF3HSP6FK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:02.465Z","job_size_bytes":65,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-e3e13f3f97e06cc25c585f9a: done: 0.036632 sec","job_status":"done","queue_duration_s":0.465509,"scheduling_latency_s":0.465524,"redis_calls":10,"redis_duration_s":0.001874,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000892,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.000982,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023309,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.036632,"completed_at":"2026-09-13T12:10:02.968Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009308,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2003gitlab # [ 254.298474] gitaly[889]: time="2026-09-13T12:10:03.093Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=70 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7736 command.oublock=0 command.real_time_ms=68 command.spawn_token_fork_ms=2 command.system_time_ms=44 command.user_time_ms=26 component=gitaly.UnaryServerInterceptor correlation_id=01M2DASA5NTNDQMV65BWF4Q69H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-13T12:10:33.018" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:10:03.018" grpc.time_ms=74.286 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2004gitlab # [ 254.299238] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:02.969Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"7da8203d6093c3fb0a3dfab9","created_at":"2026-09-13T12:10:02.475Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-a1b5f362d90f42fa","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:02.476Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7da8203d6093c3fb0a3dfab9: start","job_status":"start","queue_duration_s":0.49254,"scheduling_latency_s":0.492564}2005gitlab # [ 254.299831] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:03.158Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"7da8203d6093c3fb0a3dfab9","created_at":"2026-09-13T12:10:02.475Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-a1b5f362d90f42fa","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:02.476Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7da8203d6093c3fb0a3dfab9: done: 0.18878 sec","job_status":"done","queue_duration_s":0.49254,"scheduling_latency_s":0.492564,"gitaly_calls":3,"gitaly_duration_s":0.080809,"redis_calls":63,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.007706,"redis_read_bytes":142,"redis_write_bytes":16719,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000372,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000628,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":20,"redis_queues_duration_s":0.001741,"redis_queues_read_bytes":22,"redis_queues_write_bytes":11225,"redis_queues_metadata_calls":18,"redis_queues_metadata_duration_s":0.002852,"redis_queues_metadata_read_bytes":28,"redis_queues_metadata_write_bytes":2886,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000176,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000388,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001177,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.082545,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.165819678,"duration_s":0.18878,"completed_at":"2026-09-13T12:10:03.158Z","load_balancing_strategy":"primary","db_duration_s":0.022682,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2006gitlab # [ 254.361365] gitaly[889]: time="2026-09-13T12:10:03.103Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M2DASA5NTNDQMV65BWF4Q69H grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-13T12:10:33.018" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:10:03.018" pid=889 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2007gitlab # [ 254.362080] gitaly[889]: time="2026-09-13T12:10:03.103Z" level=info msg="optimized repository" clean_stale_data_time=15.181818ms clean_work_trees_time="75.15µs" commit_graph_time="3.632µs" correlation_id=01M2DASA5NTNDQMV65BWF4Q69H gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="4.749µs" pid=889 prune_time="3.352µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="5.028µs" storage_name=default system=housekeeping total_time=15.378211ms2008gitlab # [ 254.362698] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:03.159Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"2a78e881cfc85ec6ceeb1db9","created_at":"2026-09-13T12:10:02.513Z","trace_propagation_headers":{"sentry-trace":"ce2c215809a74df7a2cee000e59aaf28-a768d0fd68104300","baggage":"sentry-trace_id=ce2c215809a74df7a2cee000e59aaf28,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2DASAMYXW61QG4PF3HSP6FK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:02.516Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2a78e881cfc85ec6ceeb1db9: start","job_status":"start","queue_duration_s":0.643043,"scheduling_latency_s":0.643059}2009gitlab # [ 254.371669] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:03.237Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"2a78e881cfc85ec6ceeb1db9","created_at":"2026-09-13T12:10:02.513Z","trace_propagation_headers":{"sentry-trace":"ce2c215809a74df7a2cee000e59aaf28-a768d0fd68104300","baggage":"sentry-trace_id=ce2c215809a74df7a2cee000e59aaf28,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2DASAMYXW61QG4PF3HSP6FK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:02.516Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2a78e881cfc85ec6ceeb1db9: done: 0.07851 sec","job_status":"done","queue_duration_s":0.643043,"scheduling_latency_s":0.643059,"gitaly_calls":2,"gitaly_duration_s":0.004331,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.00435,"redis_read_bytes":80,"redis_write_bytes":5120,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000624,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000705,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000187,"redis_queues_read_bytes":3,"redis_queues_write_bytes":1131,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001054,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000184,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000298,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000674,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055763,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.059269544,"duration_s":0.07851,"completed_at":"2026-09-13T12:10:03.237Z","load_balancing_strategy":"primary","db_duration_s":0.017189,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2010gitlab # [ 254.426839] gitaly[889]: time="2026-09-13T12:10:03.103Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M2DASA5NTNDQMV65BWF4Q69H grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-13T12:10:33.018" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:10:03.018" pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2011gitlab # [ 254.427756] gitaly[889]: time="2026-09-13T12:10:03.130Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2DASA5NTNDQMV65BWF4Q69H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-13T12:10:33.129" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:10:03.129" grpc.time_ms=0.694 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2012gitlab # [ 254.467216] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:03.238Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"8873516889bbadcdcf22be81","created_at":"2026-09-13T12:10:03.012Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-107f827ab4c94186","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:03.014Z","job_size_bytes":23,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-8873516889bbadcdcf22be81: start","job_status":"start","queue_duration_s":0.224337,"scheduling_latency_s":0.224353}2013gitlab # [ 254.467816] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:03.264Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"8873516889bbadcdcf22be81","created_at":"2026-09-13T12:10:03.012Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-107f827ab4c94186","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:03.014Z","job_size_bytes":23,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-8873516889bbadcdcf22be81: done: 0.025626 sec","job_status":"done","queue_duration_s":0.224337,"scheduling_latency_s":0.224353,"redis_calls":7,"redis_duration_s":0.0009860000000000001,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000729,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000257,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018427,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025626,"completed_at":"2026-09-13T12:10:03.264Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004716,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2014gitlab # [ 254.506782] gitaly[889]: time="2026-09-13T12:10:03.149Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DASA5NTNDQMV65BWF4Q69H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T12:10:33.149" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:10:03.149" grpc.time_ms=0.457 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2015gitlab # [ 254.507630] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:03.265Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"2d72bafd129d3bcab0aa8262","created_at":"2026-09-13T12:10:03.098Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-107f827ab4c94186","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:03.101Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-2d72bafd129d3bcab0aa8262: start","job_status":"start","queue_duration_s":0.164194,"scheduling_latency_s":0.16421}2016gitlab # [ 254.546684] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:03.281Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"2d72bafd129d3bcab0aa8262","created_at":"2026-09-13T12:10:03.098Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-107f827ab4c94186","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:03.101Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-2d72bafd129d3bcab0aa8262: done: 0.016202 sec","job_status":"done","queue_duration_s":0.164194,"scheduling_latency_s":0.16421,"redis_calls":7,"redis_duration_s":0.000974,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000697,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000277,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011076,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016202,"completed_at":"2026-09-13T12:10:03.281Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002476,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2017gitlab # [ 254.551549] gitaly[889]: time="2026-09-13T12:10:03.207Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2DASAMYXW61QG4PF3HSP6FK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-13T12:10:33.206" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:10:03.206" grpc.time_ms=0.713 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2018gitlab # [ 254.591784] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:03.282Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"acf8e0c913ac6b5c733da41e","created_at":"2026-09-13T12:10:03.106Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-107f827ab4c94186","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:03.107Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-acf8e0c913ac6b5c733da41e: start","job_status":"start","queue_duration_s":0.174865,"scheduling_latency_s":0.17488}2019gitlab # [ 254.592767] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:03.303Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"acf8e0c913ac6b5c733da41e","created_at":"2026-09-13T12:10:03.106Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-107f827ab4c94186","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:03.107Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-acf8e0c913ac6b5c733da41e: done: 0.021031 sec","job_status":"done","queue_duration_s":0.174865,"scheduling_latency_s":0.17488,"redis_calls":7,"redis_duration_s":0.001168,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00086,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000308,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015338,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021031,"completed_at":"2026-09-13T12:10:03.303Z","load_balancing_strategy":"primary","db_duration_s":0.00297,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2020gitlab # [ 254.637840] gitaly[889]: time="2026-09-13T12:10:03.230Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DASAMYXW61QG4PF3HSP6FK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T12:10:33.229" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:10:03.229" grpc.time_ms=0.485 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2021gitlab # [ 254.638695] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:03.304Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"f6d15a6af44d44056681ee1a","created_at":"2026-09-13T12:10:03.112Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-107f827ab4c94186","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:03.113Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-f6d15a6af44d44056681ee1a: start","job_status":"start","queue_duration_s":0.191011,"scheduling_latency_s":0.191031}2022gitlab # [ 254.639465] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:03.323Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"f6d15a6af44d44056681ee1a","created_at":"2026-09-13T12:10:03.112Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-107f827ab4c94186","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:03.113Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-f6d15a6af44d44056681ee1a: done: 0.019083 sec","job_status":"done","queue_duration_s":0.191011,"scheduling_latency_s":0.191031,"redis_calls":10,"redis_duration_s":0.001307,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000692,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000367,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000248,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013257,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019083,"completed_at":"2026-09-13T12:10:03.323Z","load_balancing_strategy":"primary","db_duration_s":0.00282,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2023gitlab # [ 254.684154] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:03.324Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"c6fca8cec22766de6c25be47","created_at":"2026-09-13T12:10:03.114Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-107f827ab4c94186","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:03.115Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-c6fca8cec22766de6c25be47: start","job_status":"start","queue_duration_s":0.20969,"scheduling_latency_s":0.209704}2024gitlab # [ 254.690447] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:03.340Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"c6fca8cec22766de6c25be47","created_at":"2026-09-13T12:10:03.114Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-107f827ab4c94186","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:03.115Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-c6fca8cec22766de6c25be47: done: 0.016242 sec","job_status":"done","queue_duration_s":0.20969,"scheduling_latency_s":0.209704,"redis_calls":7,"redis_duration_s":0.001356,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000963,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000393,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010203,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016242,"completed_at":"2026-09-13T12:10:03.340Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003166,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2025gitlab # [ 254.728714] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:03.341Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"67afc9b7d0461a9c987e6edf","created_at":"2026-09-13T12:10:03.115Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-107f827ab4c94186","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:03.116Z","job_size_bytes":19,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-67afc9b7d0461a9c987e6edf: start","job_status":"start","queue_duration_s":0.225047,"scheduling_latency_s":0.22506}2026gitlab # [ 254.776934] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:03.356Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"67afc9b7d0461a9c987e6edf","created_at":"2026-09-13T12:10:03.115Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-107f827ab4c94186","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:03.116Z","job_size_bytes":19,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-67afc9b7d0461a9c987e6edf: done: 0.014399 sec","job_status":"done","queue_duration_s":0.225047,"scheduling_latency_s":0.22506,"redis_calls":8,"redis_duration_s":0.001076,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000834,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000242,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009284,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014399,"completed_at":"2026-09-13T12:10:03.356Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002213,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2027gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/eb35f4350ed549063682d3800f1c6cb20196620c/statuses2028gitlab # [ 254.778658] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:03.357Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"0158525b4c1815fd68488dfb","created_at":"2026-09-13T12:10:03.117Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-107f827ab4c94186","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:03.118Z","job_size_bytes":66,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-0158525b4c1815fd68488dfb: start","job_status":"start","queue_duration_s":0.238686,"scheduling_latency_s":0.238701}2029gitlab # [ 254.828469] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:03.370Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"0158525b4c1815fd68488dfb","created_at":"2026-09-13T12:10:03.117Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-107f827ab4c94186","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:03.118Z","job_size_bytes":66,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-0158525b4c1815fd68488dfb: done: 0.013235 sec","job_status":"done","queue_duration_s":0.238686,"scheduling_latency_s":0.238701,"redis_calls":7,"redis_duration_s":0.000986,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000732,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000254,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008993,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013235,"completed_at":"2026-09-13T12:10:03.370Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001493,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2030gitlab # [ 254.831194] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:03.371Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"767d58ddd450f5be0431ea2b","created_at":"2026-09-13T12:10:03.118Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-107f827ab4c94186","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:03.119Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-767d58ddd450f5be0431ea2b: start","job_status":"start","queue_duration_s":0.251519,"scheduling_latency_s":0.251533}2031gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/eb35f4350ed549063682d3800f1c6cb20196620c/statuses, in 0.09 seconds)2032gitlab # [ 254.874712] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:03.387Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"767d58ddd450f5be0431ea2b","created_at":"2026-09-13T12:10:03.118Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-107f827ab4c94186","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:03.119Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-767d58ddd450f5be0431ea2b: done: 0.016125 sec","job_status":"done","queue_duration_s":0.251519,"scheduling_latency_s":0.251533,"redis_calls":7,"redis_duration_s":0.0009599999999999999,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000695,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000265,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009965,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016125,"completed_at":"2026-09-13T12:10:03.387Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003656,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2033gitlab # [ 254.882597] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:03.388Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"c9eeddbb7f481eabee0fdf8e","created_at":"2026-09-13T12:10:03.120Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-107f827ab4c94186","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:03.121Z","job_size_bytes":6,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-c9eeddbb7f481eabee0fdf8e: start","job_status":"start","queue_duration_s":0.267348,"scheduling_latency_s":0.267363}2034gitlab # [ 254.926287] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:03.396Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"c9eeddbb7f481eabee0fdf8e","created_at":"2026-09-13T12:10:03.120Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-107f827ab4c94186","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:03.121Z","job_size_bytes":6,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-c9eeddbb7f481eabee0fdf8e: done: 0.008536 sec","job_status":"done","queue_duration_s":0.267348,"scheduling_latency_s":0.267363,"redis_calls":7,"redis_duration_s":0.0009630000000000001,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000706,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000257,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005445,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008536,"completed_at":"2026-09-13T12:10:03.396Z","load_balancing_strategy":"primary","db_duration_s":0.000274,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2035gitlab # [ 254.933860] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:03.397Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"a1931514268553ff1051f7a7","created_at":"2026-09-13T12:10:03.121Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-107f827ab4c94186","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:03.122Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-a1931514268553ff1051f7a7: start","job_status":"start","queue_duration_s":0.275614,"scheduling_latency_s":0.275627}2036gitlab # [ 254.971678] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:03.411Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"a1931514268553ff1051f7a7","created_at":"2026-09-13T12:10:03.121Z","trace_propagation_headers":{"sentry-trace":"8b4ca6cedfe44fe79c78c8b85acdc253-107f827ab4c94186","baggage":"sentry-trace_id=8b4ca6cedfe44fe79c78c8b85acdc253,sentry-release=Unknown"},"correlation_id":"01M2DASA5NTNDQMV65BWF4Q69H","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:03.122Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-a1931514268553ff1051f7a7: done: 0.013774 sec","job_status":"done","queue_duration_s":0.275614,"scheduling_latency_s":0.275627,"redis_calls":7,"redis_duration_s":0.000954,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000681,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000273,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009222,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013774,"completed_at":"2026-09-13T12:10:03.411Z","load_balancing_strategy":"primary","db_duration_s":0.001921,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2037gitlab # [ 255.013915] gitaly[889]: time="2026-09-13T12:10:03.924Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DASC7NK2C1PFE2NS58J5E8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T12:10:33.323" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:10:03.923" grpc.time_ms=0.615 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2038gitlab # [ 255.015059] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:10:03 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/eb35f4350ed549063682d3800f1c6cb20196620c/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 452039gitlab # [ 255.015711] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:03.412Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"b8f86f0bd79f0704fea72318","created_at":"2026-09-13T12:10:03.196Z","trace_propagation_headers":{"sentry-trace":"ce2c215809a74df7a2cee000e59aaf28-9d18c9f4918e4666","baggage":"sentry-trace_id=ce2c215809a74df7a2cee000e59aaf28,sentry-release=Unknown"},"correlation_id":"01M2DASAMYXW61QG4PF3HSP6FK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:03.197Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-b8f86f0bd79f0704fea72318: start","job_status":"start","queue_duration_s":0.214838,"scheduling_latency_s":0.214851}2040gitlab # [ 255.016254] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:03.432Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"b8f86f0bd79f0704fea72318","created_at":"2026-09-13T12:10:03.196Z","trace_propagation_headers":{"sentry-trace":"ce2c215809a74df7a2cee000e59aaf28-9d18c9f4918e4666","baggage":"sentry-trace_id=ce2c215809a74df7a2cee000e59aaf28,sentry-release=Unknown"},"correlation_id":"01M2DASAMYXW61QG4PF3HSP6FK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:03.197Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-b8f86f0bd79f0704fea72318: done: 0.020029 sec","job_status":"done","queue_duration_s":0.214838,"scheduling_latency_s":0.214851,"redis_calls":7,"redis_duration_s":0.00099,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000732,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000258,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014826,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020029,"completed_at":"2026-09-13T12:10:03.432Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002745,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2041gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/eb35f4350ed549063682d3800f1c6cb20196620c/statuses2042gitlab # [ 256.012853] gitaly[889]: time="2026-09-13T12:10:05.041Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DASD9M8H8047XFY70BF97S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T12:10:35.039" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:10:05.039" grpc.time_ms=1.121 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2043gitlab # [ 256.050511] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:10:05 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/eb35f4350ed549063682d3800f1c6cb20196620c/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 972044gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/eb35f4350ed549063682d3800f1c6cb20196620c/statuses, in 0.14 seconds)2045gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/eb35f4350ed549063682d3800f1c6cb20196620c/statuses2046gitlab # [ 257.158175] gitaly[889]: time="2026-09-13T12:10:06.186Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DASEDAAFVF2VYZAAFHFGVD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T12:10:36.084" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:10:06.185" grpc.time_ms=1.085 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2047gitlab # [ 257.189974] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:10:06 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/eb35f4350ed549063682d3800f1c6cb20196620c/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 952048gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/eb35f4350ed549063682d3800f1c6cb20196620c/statuses, in 0.14 seconds)2049gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/eb35f4350ed549063682d3800f1c6cb20196620c/statuses2050gitlab # [ 258.294558] gitaly[889]: time="2026-09-13T12:10:07.322Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DASFGYYD2V7AGFT2PNJVM6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T12:10:37.120" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:10:07.321" grpc.time_ms=0.972 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2051gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/eb35f4350ed549063682d3800f1c6cb20196620c/statuses, in 0.12 seconds)2052gitlab # [ 258.322960] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:10:07 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/eb35f4350ed549063682d3800f1c6cb20196620c/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 832053gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/eb35f4350ed549063682d3800f1c6cb20196620c/statuses2054gitlab # [ 259.433978] gitaly[889]: time="2026-09-13T12:10:08.462Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DASGM23J9WFRYSW58831BT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T12:10:38.260" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:10:08.460" grpc.time_ms=1.04 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2055gitlab # [ 259.465926] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:10:08 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/eb35f4350ed549063682d3800f1c6cb20196620c/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1062056gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/eb35f4350ed549063682d3800f1c6cb20196620c/statuses, in 0.15 seconds)2057gitlab # [ 259.718965] nix-daemon[2811]: accepted connection from pid 3715, user nixbot2058gitlab # [ 259.732764] nix-daemon[2811]: accepted connection from pid 3640, user nixbot2059gitlab # [ 259.854285] gitaly[889]: time="2026-09-13T12:10:08.883Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DASH17HRREFG0YQ9Y9D1MY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T12:10:38.281" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:10:08.882" grpc.time_ms=0.818 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2060gitlab # [ 259.943650] gitaly[889]: time="2026-09-13T12:10:08.972Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2DASH17HRREFG0YQ9Y9D1MY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-13T12:10:18.179" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:10:08.959" grpc.time_ms=12.757 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2061gitlab # [ 259.993361] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:09.020Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"c12273ffad2ee312806165ed","created_at":"2026-09-13T12:10:09.014Z","trace_propagation_headers":{"sentry-trace":"77766a8e8faf450d91b6fc5c0fe9c6c9-41033ff599c7411f","baggage":"sentry-trace_id=77766a8e8faf450d91b6fc5c0fe9c6c9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2DASH17HRREFG0YQ9Y9D1MY","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:09.018Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-c12273ffad2ee312806165ed: start","job_status":"start","queue_duration_s":0.002236,"scheduling_latency_s":0.0023}2062gitlab # [ 260.002970] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:10:09 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/eb35f4350ed549063682d3800f1c6cb20196620c HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 2242063gitlab # [ 260.005808] nixbot[2640]: {"ts": "2026-09-13T12:10:09.033Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/eb35f4350ed549063682d3800f1c6cb20196620c \"HTTP/1.1 201 Created\""}2064gitlab # [ 260.052899] gitaly[889]: time="2026-09-13T12:10:09.081Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DASH8EDQF1GYJEXEGYHC5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T12:10:39.079" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:10:09.080" grpc.time_ms=1.15 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2065gitlab # [ 260.135947] gitaly[889]: time="2026-09-13T12:10:09.165Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2DASH17HRREFG0YQ9Y9D1MY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T12:10:09.164" grpc.time_ms=0.305 pid=889 span.kind=server system=grpc2066gitlab # [ 260.140303] gitaly[889]: time="2026-09-13T12:10:09.169Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2DASH8EDQF1GYJEXEGYHC5H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-13T12:10:19.031" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:10:09.151" grpc.time_ms=17.324 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2067gitlab # [ 260.181837] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:10:09 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/eb35f4350ed549063682d3800f1c6cb20196620c HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1712068gitlab # [ 260.182851] nixbot[2640]: {"ts": "2026-09-13T12:10:09.211Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/eb35f4350ed549063682d3800f1c6cb20196620c \"HTTP/1.1 201 Created\""}2069gitlab # [ 260.194463] gitaly[889]: time="2026-09-13T12:10:09.223Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2DASH17HRREFG0YQ9Y9D1MY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T12:10:09.223" grpc.time_ms=0.382 pid=889 span.kind=server system=grpc2070gitlab # [ 260.231928] gitaly[889]: time="2026-09-13T12:10:09.261Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2DASH17HRREFG0YQ9Y9D1MY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-13T12:10:09.260" grpc.time_ms=0.39 pid=889 span.kind=server system=grpc2071gitlab # [ 260.245322] gitaly[889]: time="2026-09-13T12:10:09.274Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DASHECJ80AS8EXV64NJVMC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T12:10:39.273" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:10:09.273" grpc.time_ms=0.617 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2072gitlab # [ 260.253028] gitaly[889]: time="2026-09-13T12:10:09.282Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2DASH17HRREFG0YQ9Y9D1MY diskcache=28f6c0c9-75d7-43b9-84b0-5235b49187bf grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-13T12:10:39.129" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:10:09.130" pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2073gitlab # [ 260.253923] gitaly[889]: time="2026-09-13T12:10:09.282Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=131 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7131 command.oublock=0 command.real_time_ms=142 command.spawn_token_fork_ms=1 command.system_time_ms=97 command.user_time_ms=34 component=gitaly.UnaryServerInterceptor correlation_id=01M2DASH17HRREFG0YQ9Y9D1MY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-13T12:10:39.129" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:10:09.130" grpc.time_ms=152.079 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2074gitlab # [ 260.285487] gitaly[889]: time="2026-09-13T12:10:09.314Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2DASHECJ80AS8EXV64NJVMC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-13T12:10:19.187" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-13T12:10:09.308" grpc.time_ms=6.497 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2075gitlab # [ 260.298825] gitaly[889]: time="2026-09-13T12:10:09.327Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2DASH17HRREFG0YQ9Y9D1MY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-13T12:10:39.326" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:10:09.327" grpc.time_ms=0.861 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2076gitlab # [ 260.319279] gitaly[889]: time="2026-09-13T12:10:09.348Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DASH17HRREFG0YQ9Y9D1MY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T12:10:39.347" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-13T12:10:09.347" grpc.time_ms=0.6 pid=889 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2077gitlab # [ 260.339206] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:09.368Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"561221047f4a8f0bd9637d6c","created_at":"2026-09-13T12:10:09.366Z","trace_propagation_headers":{"sentry-trace":"77766a8e8faf450d91b6fc5c0fe9c6c9-0bd37bda3d784fd1","baggage":"sentry-trace_id=77766a8e8faf450d91b6fc5c0fe9c6c9,sentry-release=Unknown"},"correlation_id":"01M2DASH17HRREFG0YQ9Y9D1MY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"c12273ffad2ee312806165ed","job_size_bytes":3,"pid":2524,"job_status":"deduplicated","message":"PipelineProcessWorker JID-561221047f4a8f0bd9637d6c: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2078gitlab # [ 260.353827] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:09.369Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"c12273ffad2ee312806165ed","created_at":"2026-09-13T12:10:09.014Z","trace_propagation_headers":{"sentry-trace":"77766a8e8faf450d91b6fc5c0fe9c6c9-41033ff599c7411f","baggage":"sentry-trace_id=77766a8e8faf450d91b6fc5c0fe9c6c9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2DASH17HRREFG0YQ9Y9D1MY","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:09.018Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2524,"job_status":"rescheduled","message":"PipelineProcessWorker JID-c12273ffad2ee312806165ed: rescheduled"}2079gitlab # [ 260.354493] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:09.374Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"c12273ffad2ee312806165ed","created_at":"2026-09-13T12:10:09.014Z","trace_propagation_headers":{"sentry-trace":"77766a8e8faf450d91b6fc5c0fe9c6c9-41033ff599c7411f","baggage":"sentry-trace_id=77766a8e8faf450d91b6fc5c0fe9c6c9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2DASH17HRREFG0YQ9Y9D1MY","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:09.018Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-c12273ffad2ee312806165ed: done: 0.353416 sec","job_status":"done","queue_duration_s":0.002236,"scheduling_latency_s":0.0023,"gitaly_calls":3,"gitaly_duration_s":0.170742,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.012854,"redis_read_bytes":239,"redis_write_bytes":21781,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001014,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001101,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.002919,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14466,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.00425,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000226,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000415,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001915,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.007,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.01,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.015,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.095699,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.274976568,"duration_s":0.353416,"completed_at":"2026-09-13T12:10:09.374Z","load_balancing_strategy":"primary","db_duration_s":0.033543,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2080gitlab # [ 260.399861] nixbot[2640]: {"ts": "2026-09-13T12:10:09.379Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/eb35f4350ed549063682d3800f1c6cb20196620c \"HTTP/1.1 201 Created\""}2081gitlab # [ 260.400779] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:10:09 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/eb35f4350ed549063682d3800f1c6cb20196620c HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1492082gitlab # [ 260.401704] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:09.375Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"69ce8433ae982dde52ed65f1","created_at":"2026-09-13T12:10:09.124Z","trace_propagation_headers":{"sentry-trace":"77766a8e8faf450d91b6fc5c0fe9c6c9-0bd37bda3d784fd1","baggage":"sentry-trace_id=77766a8e8faf450d91b6fc5c0fe9c6c9,sentry-release=Unknown"},"correlation_id":"01M2DASH17HRREFG0YQ9Y9D1MY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:09.125Z","job_size_bytes":23,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-69ce8433ae982dde52ed65f1: start","job_status":"start","queue_duration_s":0.249795,"scheduling_latency_s":0.249826}2083gitlab # [ 260.402526] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:09.410Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"69ce8433ae982dde52ed65f1","created_at":"2026-09-13T12:10:09.124Z","trace_propagation_headers":{"sentry-trace":"77766a8e8faf450d91b6fc5c0fe9c6c9-0bd37bda3d784fd1","baggage":"sentry-trace_id=77766a8e8faf450d91b6fc5c0fe9c6c9,sentry-release=Unknown"},"correlation_id":"01M2DASH17HRREFG0YQ9Y9D1MY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:09.125Z","job_size_bytes":23,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-69ce8433ae982dde52ed65f1: done: 0.035325 sec","job_status":"done","queue_duration_s":0.249795,"scheduling_latency_s":0.249826,"redis_calls":7,"redis_duration_s":0.001157,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000868,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000289,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022494,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035325,"completed_at":"2026-09-13T12:10:09.410Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009372,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2084gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/eb35f4350ed549063682d3800f1c6cb20196620c/statuses2085gitlab # [ 260.432912] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:09.411Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"37beca450fe2103587bbdd50","created_at":"2026-09-13T12:10:09.287Z","trace_propagation_headers":{"sentry-trace":"77766a8e8faf450d91b6fc5c0fe9c6c9-0bd37bda3d784fd1","baggage":"sentry-trace_id=77766a8e8faf450d91b6fc5c0fe9c6c9,sentry-release=Unknown"},"correlation_id":"01M2DASH17HRREFG0YQ9Y9D1MY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:09.289Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-37beca450fe2103587bbdd50: start","job_status":"start","queue_duration_s":0.122185,"scheduling_latency_s":0.122202}2086gitlab # [ 260.488946] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:09.429Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"37beca450fe2103587bbdd50","created_at":"2026-09-13T12:10:09.287Z","trace_propagation_headers":{"sentry-trace":"77766a8e8faf450d91b6fc5c0fe9c6c9-0bd37bda3d784fd1","baggage":"sentry-trace_id=77766a8e8faf450d91b6fc5c0fe9c6c9,sentry-release=Unknown"},"correlation_id":"01M2DASH17HRREFG0YQ9Y9D1MY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:09.289Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-37beca450fe2103587bbdd50: done: 0.017288 sec","job_status":"done","queue_duration_s":0.122185,"scheduling_latency_s":0.122202,"redis_calls":7,"redis_duration_s":0.00109,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000813,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000277,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011431,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017288,"completed_at":"2026-09-13T12:10:09.429Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002891,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2087gitlab # [ 260.490164] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:09.431Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"c7dd79b1dabf33240b35994c","created_at":"2026-09-13T12:10:09.295Z","trace_propagation_headers":{"sentry-trace":"77766a8e8faf450d91b6fc5c0fe9c6c9-0bd37bda3d784fd1","baggage":"sentry-trace_id=77766a8e8faf450d91b6fc5c0fe9c6c9,sentry-release=Unknown"},"correlation_id":"01M2DASH17HRREFG0YQ9Y9D1MY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:09.296Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-c7dd79b1dabf33240b35994c: start","job_status":"start","queue_duration_s":0.135662,"scheduling_latency_s":0.13568}2088gitlab # [ 260.539944] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:09.449Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"c7dd79b1dabf33240b35994c","created_at":"2026-09-13T12:10:09.295Z","trace_propagation_headers":{"sentry-trace":"77766a8e8faf450d91b6fc5c0fe9c6c9-0bd37bda3d784fd1","baggage":"sentry-trace_id=77766a8e8faf450d91b6fc5c0fe9c6c9,sentry-release=Unknown"},"correlation_id":"01M2DASH17HRREFG0YQ9Y9D1MY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:09.296Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-c7dd79b1dabf33240b35994c: done: 0.018077 sec","job_status":"done","queue_duration_s":0.135662,"scheduling_latency_s":0.13568,"redis_calls":7,"redis_duration_s":0.000985,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00072,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000265,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011714,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018077,"completed_at":"2026-09-13T12:10:09.449Z","load_balancing_strategy":"primary","db_duration_s":0.003123,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2089gitlab # [ 260.541093] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:09.450Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"8d415bb510fcb99f61a454b4","created_at":"2026-09-13T12:10:09.301Z","trace_propagation_headers":{"sentry-trace":"77766a8e8faf450d91b6fc5c0fe9c6c9-0bd37bda3d784fd1","baggage":"sentry-trace_id=77766a8e8faf450d91b6fc5c0fe9c6c9,sentry-release=Unknown"},"correlation_id":"01M2DASH17HRREFG0YQ9Y9D1MY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:09.302Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-8d415bb510fcb99f61a454b4: start","job_status":"start","queue_duration_s":0.148499,"scheduling_latency_s":0.148514}2090gitlab # [ 260.581660] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:09.469Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"8d415bb510fcb99f61a454b4","created_at":"2026-09-13T12:10:09.301Z","trace_propagation_headers":{"sentry-trace":"77766a8e8faf450d91b6fc5c0fe9c6c9-0bd37bda3d784fd1","baggage":"sentry-trace_id=77766a8e8faf450d91b6fc5c0fe9c6c9,sentry-release=Unknown"},"correlation_id":"01M2DASH17HRREFG0YQ9Y9D1MY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:09.302Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-8d415bb510fcb99f61a454b4: done: 0.018628 sec","job_status":"done","queue_duration_s":0.148499,"scheduling_latency_s":0.148514,"redis_calls":10,"redis_duration_s":0.001352,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000667,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000377,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000308,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012901,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018628,"completed_at":"2026-09-13T12:10:09.469Z","load_balancing_strategy":"primary","db_duration_s":0.002753,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2091gitlab # [ 260.593168] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:09.470Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"7fcbb2b4b120254082376e02","created_at":"2026-09-13T12:10:09.302Z","trace_propagation_headers":{"sentry-trace":"77766a8e8faf450d91b6fc5c0fe9c6c9-0bd37bda3d784fd1","baggage":"sentry-trace_id=77766a8e8faf450d91b6fc5c0fe9c6c9,sentry-release=Unknown"},"correlation_id":"01M2DASH17HRREFG0YQ9Y9D1MY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:09.303Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-7fcbb2b4b120254082376e02: start","job_status":"start","queue_duration_s":0.16679,"scheduling_latency_s":0.166806}2092gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/eb35f4350ed549063682d3800f1c6cb20196620c/statuses, in 0.21 seconds)2093(finished: subtest: eval and build post commit statuses, in 6.96 seconds)2094(finished: run the VM test script, in 307.70 seconds)2095gitlab # [ 260.608522] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:09.486Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"7fcbb2b4b120254082376e02","created_at":"2026-09-13T12:10:09.302Z","trace_propagation_headers":{"sentry-trace":"77766a8e8faf450d91b6fc5c0fe9c6c9-0bd37bda3d784fd1","baggage":"sentry-trace_id=77766a8e8faf450d91b6fc5c0fe9c6c9,sentry-release=Unknown"},"correlation_id":"01M2DASH17HRREFG0YQ9Y9D1MY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:09.303Z","job_size_bytes":3,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-7fcbb2b4b120254082376e02: done: 0.015553 sec","job_status":"done","queue_duration_s":0.16679,"scheduling_latency_s":0.166806,"redis_calls":7,"redis_duration_s":0.000991,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000716,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000275,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010431,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015553,"completed_at":"2026-09-13T12:10:09.486Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002327,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2096gitlab # [ 260.676837] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:09.487Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"7ae6f12bdf800234aa39d8e9","created_at":"2026-09-13T12:10:09.304Z","trace_propagation_headers":{"sentry-trace":"77766a8e8faf450d91b6fc5c0fe9c6c9-0bd37bda3d784fd1","baggage":"sentry-trace_id=77766a8e8faf450d91b6fc5c0fe9c6c9,sentry-release=Unknown"},"correlation_id":"01M2DASH17HRREFG0YQ9Y9D1MY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:09.305Z","job_size_bytes":19,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-7ae6f12bdf800234aa39d8e9: start","job_status":"start","queue_duration_s":0.181578,"scheduling_latency_s":0.181593}2097gitlab # [ 260.678234] sidekiq-cluster[2524]: {"severity":"INFO","time":"2026-09-13T12:10:09.506Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"7ae6f12bdf800234aa39d8e9","created_at":"2026-09-13T12:10:09.304Z","trace_propagation_headers":{"sentry-trace":"77766a8e8faf450d91b6fc5c0fe9c6c9-0bd37bda3d784fd1","baggage":"sentry-trace_id=77766a8e8faf450d91b6fc5c0fe9c6c9,sentry-release=Unknown"},"correlation_id":"01M2DASH17HRREFG0YQ9Y9D1MY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-09-13T12:10:09.305Z","job_size_bytes":19,"pid":2524,"sidekiq_tid":"m7wo","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-7ae6f12bdf800234aa39d8e9: done: 0.019834 sec","job_status":"done","queue_duration_s":0.181578,"scheduling_latency_s":0.181593,"redis_calls":8,"redis_duration_s":0.0014320000000000001,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000432,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013484,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019834,"completed_at":"2026-09-13T12:10:09.506Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003051,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2098gitlab # [ 260.738454] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/09/13:12:10:09 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/eb35f4350ed549063682d3800f1c6cb20196620c/statuses HTTP/1.1" 200 1334 "" "curl/8.21.0" 1752099test script finished in 307.77s2100cleanup2101kill QemuMachine (pid 46)2102gitlab # [ 260.746355] gitaly[889]: time="2026-09-13T12:10:09.683Z" level=info msg="finished unary call with code OK" catfile.duration_ms=53 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=53 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2DASHQRG56Y4A409WZJ26EB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-13T12:10:39.429" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.staqemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14)2103gitlab # r2104(finished: cleanup, in 1.36 seconds)2105additionally exposed symbols:2106 gitlab,2107 vlan1,2108 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2109[]2110[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-09-13T12:09:11.610Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2111[]2112[]2113[]2114[]2115[]2116[]2117[]2118[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': 'eb35f4350ed549063682d3800f1c6cb20196620c', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-09-13T12:10:02.261675Z', 'started_at': '2026-09-13T12:10:02.534485Z', 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': None}]2119[{'id': 5, 'sha': 'eb35f4350ed549063682d3800f1c6cb20196620c', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-13T12:10:02.508Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2120[{'id': 5, 'sha': 'eb35f4350ed549063682d3800f1c6cb20196620c', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-13T12:10:02.508Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2121[{'id': 5, 'sha': 'eb35f4350ed549063682d3800f1c6cb20196620c', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-13T12:10:02.508Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2122[{'id': 5, 'sha': 'eb35f4350ed549063682d3800f1c6cb20196620c', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-13T12:10:02.508Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2123[{'id': 5, 'sha': 'eb35f4350ed549063682d3800f1c6cb20196620c', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-13T12:10:02.508Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2124[{'id': 5, 'sha': 'eb35f4350ed549063682d3800f1c6cb20196620c', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-13T12:10:02.508Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2125[{'id': 5, 'sha': 'eb35f4350ed549063682d3800f1c6cb20196620c', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 6s (1 warning)', 'created_at': '2026-09-13T12:10:02.508Z', 'started_at': None, 'finished_at': '2026-09-13T12:10:09.004Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': 'eb35f4350ed549063682d3800f1c6cb20196620c', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-09-13T12:10:09.192Z', 'started_at': None, 'finished_at': '2026-09-13T12:10:09.358Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]